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PREFACE 



This preface is addressed to instructors as well as students at the junior-senior 
level for the following reasons. I have been teaching courses on digital signal 
processing, including its applications and digital filter design, at the undergraduate 
and the graduate levels for more than 25 years. One common complaint I have 
heard from undergraduate students in recent years is that there are not enough 
numerical problems worked out in the chapters of the book prescribed for the 
course. But some of the very well known textbooks on digital signal processing 
have more problems than do a few of the books published in earlier years. 
However, these books are written for students in the senior and graduate levels, 
and hence the junior-level students find that there is too much of mathematical 
theory in these books. They also have concerns about the advanced level of 
problems found at the end of chapters. I have not found a textbook on digital 
signal processing that meets these complaints and concerns from junior-level 
students. So here is a book that I have written to meet the junior students' needs 
and written with a student-oriented approach, based on many years of teaching 
courses at the junior level. 

Network Analysis is an undergraduate textbook authored by my Ph.D. thesis 
advisor Professor M. E. Van Valkenburg (published by Prentice-Hall in 1964), 
which became a world-famous classic, not because it contained an abundance of 
all topics in network analysis discussed with the rigor and beauty of mathematical 
theory, but because it helped the students understand the basic ideas in their sim- 
plest form when they took the first course on network analysis. I have been highly 
influenced by that book, while writing this textbook for the first course on digital 
signal processing that the students take. But I also have had to remember that the 
generation of undergraduate students is different; the curriculum and the topic of 
digital signal processing is also different. This textbook does not contain many of 
the topics that are found in the senior-graduate-level textbooks mentioned above. 
One of its main features is that it uses a very large number of numerical problems 
as well as problems using functions from MATLAB® (MATLAB is a registered 
trademark of The Math Works, Inc.) and Signal Processing Toolbox, worked out 
in every chapter, in order to highlight the fundamental concepts. These prob- 
lems are solved as examples after the theory is discussed or are worked out first 
and the theory is then presented. Either way, the thrust of the approach is that 
the students should understand the basic ideas, using the worked, out problems 
as an instrument to achieve that goal. In some cases, the presentation is more 
informal than in other cases. The students will find statements beginning with 
"Note that. . .," "Remember. . .," or "It is pointed out," and so on; they are meant 
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to emphasize the important concepts and the results stated in those sentences. 
Many of the important results are mentioned more than once or summarized in 
order to emphasize their significance. 

The other attractive feature of this book is that all the problems given at the 
end of the chapters are problems that can be solved by using only the material 
discussed in the chapters, so that students would feel confident that they have an 
understanding of the material covered in the course when they succeed in solving 
the problems. Because of such considerations mentioned above, the author claims 
that the book is written with a student-oriented approach. Yet, the students should 
know that the ability to understand the solution to the problems is important but 
understanding the theory behind them is far more important. 

The following paragraphs are addressed to the instructors teaching a junior- 
level course on digital signal processing. The first seven chapters cover well- 
defined topics: (1) an introduction, (2) time-domain analysis and z-transform, 
(3) frequency-domain analysis, (4) infinite impulse response filters, (5) finite 
impulse response filters, (6) realization of structures, and (7) quantization filter 
analysis. Chapter 8 discusses hardware design, and Chapter 9 covers MATLAB. 
The book treats the mainstream topics in digital signal processing with a well- 
defined focus on the fundamental concepts. 

Most of the senior-graduate-level textbooks treat the theory of finite wordlength 
in great detail, but the students get no help in analyzing the effect of finite word- 
length on the frequency response of a filter or designing a filter that meets a set 
of frequency response specifications with a given wordlength and quantization 
format. In Chapter 7, we discuss the use of a MATLAB tool known as the "FDA 
Tool" to thoroughly investigate the effect of finite wordlength and different formats 
of quantization. This is another attractive feature of the textbook, and the material 
included in this chapter is not found in any other textbook published so far. 

When the students have taken a course on digital signal processing, and join an 
industry that designs digital signal processing (DSP) systems using commercially 
available DSP chips, they have very little guidance on what they need to learn. 
It is with that concern that additional material in Chapter 8 has been added, 
leading them to the material that they have to learn in order to succeed in their 
professional development. It is very brief but important material presented to 
guide them in the right direction. The textbooks that are written on DSP hardly 
provide any guidance on this matter, although there are quite a few books on 
the hardware implementation of digital systems using commercially available 
DSP chips. Only a few schools offer laboratory-oriented courses on the design 
and testing of digital systems using such chips. Even the minimal amount of 
information in Chapter 8 is not found in any other textbook that contains "digital 
signal processing" in its title. However, Chapter 8 is not an exhaustive treatment 
of hardware implementation but only as an introduction to what the students have 
to learn when they begin a career in the industry. 

Chapter 1 is devoted to discrete-time signals. It describes some applications 
of digital signal processing and defines and, suggests several ways of describing 
discrete-time signals. Examples of a few discrete-time signals and some basic 



PREFACE Xiii 



operations applied with them is followed by their properties. In particular, 
the properties of complex exponential and sinusoidal discrete-time signals are 
described. A brief history of analog and digital filter design is given. Then the 
advantages of digital signal processing over continuous-time (analog) signal pro- 
cessing is discussed in this chapter. 

Chapter 2 is devoted to discrete-time systems. Several ways of modeling them 
and four methods for obtaining the response of discrete-time systems when 
excited by discrete-time signals are discussed in detail. The four methods are 
(1) recursive algorithm, (2) convolution sum, (3) classical method, and (4) z- 
transform method to find the total response in the time domain. The use of 
z-transform theory to find the zero state response, zero input response, natural 
and forced responses, and transient and steady-state responses is discussed in 
great detail and illustrated with many numerical examples as well as the apph- 
cation of MATLAB functions. Properties of discrete-time systems, unit pulse 
response and transfer functions, stability theory, and the Jury-Marden test are 
treated in this chapter. The amount of material on the time-domain analysis of 
discrete-time systems is a lot more than that included in many other textbooks. 

Chapter 3 concentrates on frequency-domain analysis. Derivation of sam- 
pUng theorem is followed by the derivation of the discrete-time Fourier trans- 
form (DTFT) along with its importance in filter design. Several properties of 
DTFT and examples of deriving the DTFT of typical discrete-time signals are 
included with many numerical examples worked out to explain them. A large 
number of problems solved by MATLAB functions are also added. This chapter 
devoted to frequency-domain analysis is very different from those found in other 
textbooks in many respects. 

The design of infiiute impulse response (IIR) filters is the main topic of 
Chapter 4. The theory of approximation of analog filter functions, design of 
analog filters that approximate specified frequency response, the use of impulse- 
invariant transformation, and bilinear transformation are discussed in this chapter. 
Plenty of numerical examples are worked out, and the use of MATLAB functions 
to design many more filters are included, to provide a hands-on experience to 
the students. 

Chapter 5 is concerned with the theory and design of finite impulse response 
(FIR) filters. Properties of FIR filters with linear phase, and design of such filters 
by the Fourier series method modified by window functions, is a major part of 
this chapter. The design of equiripple FIR filters using the Remez exchange algo- 
rithm is also discussed in this chapter. Many numerical examples and MATLAB 
functions are used in this chapter to illustrate the design procedures. 

After learning several methods for designing IIR and FIR filters from Chapters 
4 and 5, the students need to obtain as many realization structures as possible, 
to enable them to investigate the effects of finite wordlength on the frequency 
response of these structures and to select the best structure. In Chapter 6, we 
describe methods for deriving several structures for realizing FIR filters and IIR 
filters. The structures for FIR filters describe the direct, cascade, and polyphase 
forms and the lattice structure along with their transpose forms. The structures for 
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IIR filters include direct-form and cascade and parallel structures, lattice-ladder 
structures with autoregressive (AR), moving-average (MA), and allpass struc- 
tures as special cases, and lattice-coupled allpass structures. Again, this chapter 
contains a large number of examples worked out numerically and using the func- 
tions from MATLAB and Signal Processing Toolbox; the material is more than 
what is found in many other textbooks. 

The effect of finite wordlength on the frequency response of filters realized 
by the many structures discussed in Chapter 6 is treated in Chapter 7, and the 
treatment is significantly different from that found in all other textbooks. There 
is no theoretical analysis of finite wordlength effect in this chapter, because it 
is beyond the scope of a junior-level course. I have chosen to illustrate the use 
of a MATLAB tool called the "FDA Tool" for investigating these effects on the 
different structures, different transfer functions, and different formats for quan- 
tizing the values of filter coefficients. The additional choices such as truncation, 
rounding, saturation, and scaUng to find the optimum filter structure, besides the 
alternative choices for the many structures, transfer functions, and so on, makes 
this a more powerful tool than the theoretical results. Students would find expe- 
rience in using this tool far more useful than the theory in practical hardware 
implementation. 

Chapters 1-7 cover the core topics of digital signal processing. Chapter 8, 
on hardware implementation of digital filters, briefly describes the simulation 
of digital filters on Simulink®, and the generation of C code from Simulink 
using Real-Time Workshop® (Simulink and Real-Time Workshop are registered 
trademarks of The Math Works, Inc.), generating assembly language code from the 
C code, linking the separate sections of the assembly language code to generate an 
executable object code under the Code Composer Studio from Texas Instruments 
is outlined. Information on DSP Development Starter kits and simulator and 
emulator boards is also included. Chapter 9, on MATLAB and Signal Processing 
Toolbox, concludes the book. 

The author suggests that the first three chapters, which discuss the basics of 
digital signal processing, can be taught at the junior level in one quarter. The pre- 
requisite for taking this course is a junior-level course on linear, continuous-time 
signals and systems that covers Laplace transform, Fourier transform, and Fourier 
series in particular. Chapters 4-7, which discuss the design and implementation 
of digital filters, can be taught in the next quarter or in the senior year as an 
elective course depending on the curriculum of the department. Instructors must 
use discretion in choosing the worked-out problems for discussion in the class, 
noting that the real purpose of these problems is to help the students understand 
the theory. There are a few topics that are either too advanced for a junior-level 
course or take too much of class time. Examples of such topics are the derivation 
of the objective function that is minimized by the Remez exchange algorithm, the 
formulas for deriving the lattice-ladder realization, and the derivation of the fast 
Fourier transform algorithm. It is my experience that students are interested only 
in the use of MATLAB functions that implement these algorithms, and hence 1 
have deleted a theoretical exposition of the last two topics and also a description 
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of the optimization technique in the Remez exchange algorithm. However, I have 
included many examples using the MATLAB functions to explain the subject 
matter. 

Solutions to the problems given at the end of chapters can be obtained by the in- 
structors from the Website http://www.wiley.com/WileyCDA/WileyTitle/ 
productcd-047i46482i.html. They have to access the solutions by clicking 
"Download the software solutions manual link" displayed on the Webpage. The 
author plans to add more problems and their solutions, posting them on the Website 
frequently after the book is published. 

As mentioned at the beginning of this preface, the book is written from my 
own experience in teaching a junior-level course on digital signal processing. 
I wish to thank Dr. M. D. Srinath, Southern Methodist University, Dallas, for 
making a thorough review and constructive suggestions to improve the material 
of this book. I also wish to thank my colleague Dr. A. K. Shaw, Wright State 
University, Dayton. And I am most grateful to my wife Suman, who has spent 
hundreds of lonely hours while I was writing this book. Without her patience 
and support, I would not have even started on this project, let alone complete it. 
So I dedicate this book to her and also to our family. 

B. A. Shenoi 



May 2005 



CHAPTER 1 



Introduction 



1.1 INTRODUCTION 

We are living in an age of information technology. Most of this technology is 
based on the theory of digital signal processing (DSP) and implementation of 
the theory by devices embedded in what are known as digital signal processors 
(DSPs). Of course, the theory of digital signal processing and its applications 
is supported by other disciplines such as computer science and engineering, and 
advances in technologies such as the design and manufacturing of very large 
scale integration (VLSI) chips. The number of devices, systems, and applications 
of digital signal processing currently affecting our lives is very large and there 
is no end to the list of new devices, systems, and applications expected to be 
introduced into the market in the coming years. Hence it is difficult to forecast 
the future of digital signal processing and the impact of information technology. 
Some of the current apphcations are described below. 



1.2 APPLICATIONS OF DSP 

Digital signal processing is used in several areas, including the following: 

1. Telecommunications. Wireless or mobile phones are rapidly replacing 
wired (landline) telephones, both of which are connected to a large-scale telecom- 
munications network. They are used for voice communication as well as data 
communications. So also are the computers connected to a different network 
that is used for data and information processing. Computers are used to gen- 
erate, transmit, and receive an enormous amount of information through the 
Internet and will be used more extensively over the same network, in the com- 
ing years for voice communications also. This technology is known as voice 
over Internet protocol (VoIP) or Internet telephony. At present we can transmit 
and receive a limited amount of text, graphics, pictures, and video images from 
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mobile phones, besides voice, music, and other audio signals — all of which are 
classified as multimedia — because of limited hardware in the mobile phones and 
not the software that has already been developed. However, the computers can 
be used to carry out the same functions more efficiently with greater memory and 
large bandwidth. We see a seamless integration of wireless telephones and com- 
puters already developing in the market at present. The new technologies being 
used in the abovementioned applications are known by such terms as CDMA, 
TDMA,^ spread spectrum, echo cancellation, channel coding, adaptive equaliza- 
tion, ADPCM coding, and data encryption and decryption, some of which are 
used in the software to be introduced in the third-generation (G3) mobile phones. 

2. Speech Processing. The quality of speech transmission in real time over 
telecommunications networks from wired (landline) telephones or wireless (cel- 
lular) telephones is very high. Speech recognition, speech synthesis, speaker 
verification, speech enhancement, text-to-speech translation, and speech-to-text 
dictation are some of the other applications of speech processing. 

3. Consumer Electronics . We have already mentioned cellular or mobile 
phones. Then we have HDTV, digital cameras, digital phones, answering 
machines, fax and modems, music synthesizers, recording and mixing of music 
signals to produce CD and DVDs. Surround-sound entertainment systems includ- 
ing CD and DVD players, laser printers, copying machines, and scanners are 
found in many homes. But the TV set, PC, telephones, CD-DVD players, and 
scanners are present in our homes as separate systems. However, the TV set can 
be used to read email and access the Internet just like the PC; the PC can be 
used to tune and view TV channels, and record and play music as well as data 
on CD-DVD in addition to their use to make telephone calls on VoIP. This trend 
toward the development of fewer systems with multiple apphcations is expected 
to accelerate in the near future. 

4. Biomedical Systems . The variety of machines used in hospitals and biomed- 
ical applications is staggering. Included are X-ray machines, MRI, PET scanning, 
bone scanning, CT scanning, ultrasound imaging, fetal monitoring, patient moni- 
toring, and ECG and EEC mapping. Another example of advanced digital signal 
processing is found in hearing aids and cardiac pacemakers. 

5. Image Processing. Image enhancement, image restoration, image under- 
standing, computer vision, radar and sonar processing, geophysical and seismic 
data processing, remote sensing, and weather monitoring are some of the applica- 
tions of image processing. Reconstruction of two-dimensional (2D) images from 
several pictures taken at different angles and three-dimensional (3D) images from 
several contiguous slices has been used in many applications. 

6. Military Electronics. The applications of digital signal processing in mili- 
tary and defense electronics systems use very advanced techniques. Some of the 
applications are GPS and navigation, radar and sonar image processing, detection 

'Code- and time-division multiple access. In the following sections we will mention several technical 
terms and well-known acronyms without any explanation or definition. A few of them will be 
described in detail in the remaining part of this book. 
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and tracking of targets, missile guidance, secure communications, jamming and 
countermeasures, remote control of surveillance aircraft, and electronic warfare. 

7. Aerospace and Automotive Electronics . Applications include control of air- 
craft and automotive engines, monitoring and control of flying performance of 
aircraft, navigation and communications, vibration analysis and antiskid control 
of cars, control of brakes in aircrafts, control of suspension, and riding comfort 
of cars. 

8. Industrial Applications . Numerical control, robotics, control of engines and 
motors, manufacturing automation, security access, and videoconferencing are a 
few of the industrial applications. 

Obviously there is some overlap among these applications in different devices 

and systems. It is also true that a few basic operations are common in all the 
applications and systems, and these basic operations will be discussed in the 
following chapters. The list of appUcations given above is not exhaustive. A few 
applications are described in further detail in [1]. Needless to say, the number of 
new applications and improvements to the existing applications will continue to 
grow at a very rapid rate in the near future. 



1.3 DISCRETE-TIME SIGNALS 

A signal defines the variation of some physical quantity as a function of one 
or more independent variables, and this variation contains information that is of 
interest to us. For example, a continuous-time signal that is periodic contains the 
values of its fundamental frequency and the harmonics contained in it, as well 
as the amplitudes and phase angles of the individual harmonics. The purpose of 
signal processing is to modify the given signal such that the quality of information 
is improved in some well-defined meaning. For example, in mixing consoles for 
recording music, the frequency responses of different filters are adjusted so that 
the overall quality of the audio signal (music) offers as high fidelity as possible. 
Note that the contents of a telephone directory or the encyclopedia downloaded 
from an Internet site contains a lot of useful information but the contents do 
not constitute a signal according to the definition above. It is the functional 
relationship between the function and the independent variable that allows us to 
derive methods for modeling the signals and find the output of the systems when 
they are excited by the input signals. This also leads us to develop methods for 
designing these systems such that the information contained in the input signals 
is improved. 

We define a continuous-time signal as a function of an independent variable 
that is continuous. A one-dimensional continuous-time signal f{t) is expressed 
as a function of time that varies continuously from — oo to oo. But it may be 
a function of other variables such as temperature, pressure, or elevation; yet we 
will denote them as continuous-time signals, in which time is continuous but the 
signal may have discontinuities at some values of time. The signal may be a 
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real- or complex-valued function of time. We can also define a continuous-time 
signal as a mapping of the set of all values of time to a set of corresponding 
values of the functions that are subject to certain properties. Since the function is 
well defined for all values of time in —oo to oo, it is differentiable at all values 
of the independent variable t (except perhaps at a finite number of values). Two 
examples of continuous-time functions are shown in Figure 1.1. 

A discrete-time signal is a function that is defined only at discrete instants of 
time and undefined at all other values of time. Although a discrete-time function 
may be defined at arbitrary values of time in the interval — oo to oo, we will 
consider only a function defined at equal intervals of time and defined ait — nT, 
where T is a fixed interval in seconds known as the sampling period and n 
is an integer variable defined over — oo to oo. If we choose to sample f{t) at 
equal intervals of T seconds, we generate f(nT) — fit)\,^„j as a sequence of 
numbers. Since T is fixed, f(nT) is a function of only the integer variable n and 
hence can be considered as a function of n or expressed as f(n). The continuous- 
time function f{t) and the discrete-time function /(«) are plotted in Figure 1.2. 

In this book, we will denote a discrete-time (DT) function as a DT sequence, 
DT signal, or a DT series. So a DT function is a mapping of a set of all integers 
to a set of values of the functions that may be real-valued or complex-valued. 
Values of both f{t) and /(«) are assumed to be continuous, taking any value 
in a continuous range; hence can have a value even with an infinite number of 
digits, for example, /(3) — 0.4\/2 in Figure 1.2. 

A zero-order hold (ZOH) circuit is used to sample a continuous signal f{t) 
with a sampling period T and hold the sampled values for one period before the 
next sampling takes place. The DT signal so generated by the ZOH is shown in 
Figure 1.3, in which the value of the sample value during each period of sam- 
pling is a constant; the sample can assume any continuous value. The signals of 
this type are known as sampled-data signals, and they are used extensively in 
sampled-data control systems and switched-capacitor filters. However, the dura- 
tion of time over which the samples are held constant may be a very small 
fraction of the sampling period in these systems. When the value of a sample 
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Figure 1.3 Sampled data signal. 
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is held constant during a period T (or a fraction of T) by the ZOH circuit as 
its output, that signal can be converted to a value by a quantizer circuit, with 
finite levels of value as determined by the binary form of representation. Such a 
process is called binary coding or quantization. A This process is discussed in 
full detail in Chapter 7. The precision with which the values are represented is 
determined by the number of bits (binary digits) used to represent each value. 
If, for example, we select 3 bits, to express their values using a method known 
as "signed magnitude fixed-point binary number representation" and one more 
bit to denote positive or negative values, we have the finite number of values, 
represented in binary form and in their equivalent decimal form. Note that a 
4-bit binary form can represent values between — | and | at 15 distinct levels 
as shown in Table 1.1. So a value of fin) at the output of the ZOH, which lies 
between these distinct levels, is rounded or truncated by the quantizer according 
to some rules and the output of the quantizer when coded to its equivalent binary 
representation, is called the digital signal. Although there is a difference between 
the discrete-time signal and digital signal, in the next few chapters we assume 
that the signals are discrete-time signals and in Chapter 7, we consider the effect 
of quantizing the signals to their binary form, on the frequency response of the 



TABLE 1.1 4 Bit Binary Numbers 
and their Decimal Equivalents 



Binary Form Decimal Value 



OaHi 


7 
8 


0.875 


OaHo 


' 

8 


0.750 


OaIOI 


• 

8 ~ 


0.625 


OaIOO 


4 

8 ~ 


0.500 


OaOII 


3 
8 


0.375 


OaOIO 


; 

8 


0.250 


OaOOI 


1 

8 


0.125 


OaOOO 


i i = 


0.000 


IaOOO 


-0.0 = 


-0.000 


IaOOI 


1 

8 


-0.125 


IaOIO 


■ 

8 


-0.250 


IaOH 


• 

8 


-0.375 


1a 100 


1 

8 ~ 


-0.500 


IaIOI 


5 

8 ~ 


-0.625 


IaHO 


6 
8 


-0.750 


IaIII 


■ 

8 ~ 


-0.875 
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filters. However, we use the terms digital filter and discrete-time system inter- 
changeably in this book. Continuous-time signals and systems are also called 
analog signals and analog systems, respectively. A system that contains both the 
ZOH circuit and the quantizer is called an analog-to digital converter (ADC), 
which will be discussed in more detail in Chapter 7. 

Consider an analog signal as shown by the solid line in Figure 1.2. When it 
is sampled, let us assume that the discrete-time sequence has values as listed 
in the second column of Table 1.2. They are expressed in only six significant 
decimal digits and their values, when truncated to four digits, are shown in the 
third column. When these values are quantized by the quantizer with four binary 
digits (bits), the decimal values are truncated to the values at the finite discrete 
levels. In decimal number notation, the values are listed in the fourth column, 
and in binary number notation, they are listed in the fifth column of Table 1.2. 
The binary values of f{n) listed in the third column of Table 1.2 are plotted in 
Figure 1.4. 

A continuous-time signal f{t) or a discrete-time signal f{n) expresses the 
variation of a physical quantity as a function of one variable. A black-and-white 
photograph can be considered as a two-dimensional signal /(m, r), when the 
intensity of the dots making up the picture is measured along the horizontal axis 
{x axis; abscissa) and the vertical axis {y axis; ordinate) of the picture plane 
and are expressed as a function of two integer variables m and r, respectively. 
We can consider the signal f{m,r) as the discretized form of a two-dimensional 
signal fix, y), where x and y are the continuous spatial variables for the hor- 
izontal and vertical coordinates of the picture and Ti and T2 are the sampling 



TABLE 1.2 Numbers in Decimal and Binary Forms 







Values of /(«) 








Decimal 


Truncated to 


Quantized 


Binary 


n 


Values of /(n) 


Four Digits 


Values of /(n) 


Number Form 


-4 


-0.054307 


-0.0543 


0.000 


IaOOO 


-3 


-0.253287 


-0.2532 


-0.250 


IaOIO 


-2 


-0.236654 


-0.2366 


-0.125 


IaOOI 


-1 


-0.125101 


-0.1251 


-0.125 


IaOOI 


0 


0.522312 


0.5223 


0.000 


OaOOO 


1 


0.246210 


0.2462 


0.125 


OaOOI 


2 


0.387508 


0.3875 


0.375 


OaOII 


3 


0.554090 


0.5540 


0.500 


OaIOO 


4 


0.521112 


0.5211 


0.500 


OaIOO 


5 


0.275432 


0.2754 


0.250 


OaOIO 


6 


0.194501 


0.1945 


0.125 


OaOOI 


7 


0.168887 


0.1687 


0.125 


OaOOI 


8 


0.217588 


0.2175 


0.125 


OaOOI 
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Figure 1.4 Binary values in Table 1.2, after truncation of /(n) to 4 bits. 



periods (measured in meters) along the x and y axes, respectively. In other words, 

A black-and-white video signal f{x,y,t) is a 3D function of two spatial 
coordinates x and y and one temporal coordinate t. When it is discretized, we 
have a 3D discrete signal f(m, p, n). When a color video signal is to be modeled, 
it is expressed by a vector of three 3D signals, each representing one of the 
three primary colors — red, green, and blue — or their equivalent forms of two 
luminance and one chrominance. So this is an example of multivariable function 
or a multichannel signal: 



F(m, r, n) = 



fr(m,p,n) 
fgim, p, n) 
_ fb{m, p,n) 



(1.1) 



1.3.1 Modeling and Properties of Discrete-Time Signals 

There are several ways of describing the functional relationship between the 
integer variable n and the value of the discrete-time signal f(n): (1) to plot the 
values of f(n) versus n as shown in Figure 1.2, (2) to tabulate their values as 
shown in Table 1.2, and (3) to define the sequence by expressing the sample 
values as elements of a set, when the sequence has a finite number of samples. 

For example, in a sequence xi(n) as shown below, the arrow indicates the 
value of the sample when n — 0: 



xi(n)= 2 3 1.5 0.5 -1 4 



(1.2) 
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We denote the DT sequence by x(n) and also the value of a sample of the 
sequence at a particular value of n by x{n). If a sequence has zero values for 
n < 0, then it is called a causal sequence. It is misleading to state that the 
causal function is a sequence defined for n > 0, because, strictly speaking, a DT 
sequence has to be defined for all values of n. Hence it is understood that a causal 
sequence has zero- valued samples for — oo < n < 0. Similarly, when a function 
is defined for Ni < n < N2, it is understood that the function has zero values for 
—00 <n < N\ and N2 < n < 00. So the sequence x\{n) in Equation (1.2) has 
zero values for 2 < n < 00 and for —00 < n < —3. The discrete-time sequence 
X2(n) given below is a causal sequence. In this form for representing X2in), it is 
implied that X2(n) = 0 for —00 < n < 0 and also for 4 < n < 00: 

X2in) = jl -2 0.4 0.3 0.4 0 0 oj (1.3) 

The length of a finite sequence is often defined by other authors as the number 
of samples, which becomes a little ambiguous in the case of a sequence like X2(n) 
given above. The function X2in) is the same as x^in) given below: 

X3(n) = jl -2 0.4 0.3 0.4 0 0 0 0 0 oJ (1.4) 

But does it have more samples? So the length of the sequence x^in) would be 
different from the length of X2in) according to the definition above. When a 
sequence such as x^in) given below is considered, the definition again gives an 
ambiguous answer: 

X4in) ={00 0.4 0.3 0.4j (1.5) 

The definition for the length of a DT sequence would be refined when we 
define the degree (or order) of a polynomial in to express the z transform of 
a DT sequence, in the next chapter. 

To model the discrete-time signals mathematically, instead of listing their 
values as shown above or plotting as shown in Figure 1.2, we introduce some 
basic DT functions as follows. 

1.3.2 Unit Pulse Function 

The unit pulse function 5(n) is defined by 

m = {l 1 = 1 (1.6) 

and it is plotted in Figure 1.5a. It is often called the unit sample function and also 
the unit impulse function. But note that the function 8{n) has a finite numerical 
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8(n) 



5(n - 3) 



5(n + 3) 



-2-1 



H — I h 



H — h 



H — H 

01 2 3...n^ -101 2 3...n^ -3-2-1 0 1 2 3 . . . n - 

(a) (b) (c) 

Figure 1.5 Unit pulse functions S(n), S{n — 3), and S(n + 3). 



H — I h 



value of one at « = 0 and zero at all other values of integer n, whereas the unit 
impulse function S{t) is defined entirely in a different way. 

When the unit pulse function is delayed by k samples, it is described by 

Sin-k)^[l 1 = 1 (1.7) 

and it is plotted in Figure 1.5b for ^ = 3. When 8{n) is advanced by ^ = 3, we 
get S(n + k), and it is plotted in Figure 1.5c. 



1.3.3 Constant Sequence 

This sequence x(n) has a constant value for all n and is therefore defined by 
x{n) — K; — oo < n < oo. 



1.3.4 Unit Step Function 

The unit step function u{n) is defined by 

«(n)=jo (1.8) 

and it is plotted in Figure 1.6a. 

When the unit step function is delayed by k samples, where k is a positive 
integer, we have 
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step functions. 



The sequence u(n +k) is obtained when u{n) is advanced by k samples. It is 
defined by 



u(n + k) = 



n > 
n < 



-k 
-k 



(1.10) 



We also define the function u{—n), obtained from the time reversal of u{n), as a 
sequence that is zero for n > 0. The sequences u(—n + k) and u{—n — k), where 
^ is a positive integer, are obtained when u{—n) is delayed by k samples and 
advanced by k samples, respectively. In other words, m(— n + k) is obtained by 
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delaying u{—n) when k is positive and obtained by advancing u{—n) when is a 
negative integer. Note that the effect on u{—n — k) is opposite that on uin — k), 
when k is assumed to take positive and negative values. These functions are 
shown in Figure 1.6, where ^ = 2. In a strict sense, all of these functions are 
defined impUcitly for — oo < n < oo. 

1.3.5 Real Exponential Function 

The real exponential function is defined by 

x(n) = a"; — oo < n < oo (1-11) 

where a is real constant. If a is a complex constant, it becomes the complex 
exponential sequence. The real exponential sequence or the complex exponential 
sequence may also be defined by a more general relationship of the form 

\ a" k < n < oo /I 

A special discrete-time sequence that we often use is the function defined for 
n > 0: 

xin) = a" uin) (1. 13) 

An example of xi(n) — (0.8)"M(n) is plotted in Figure 1.7a. The function X2(n) = 
xi{n — 3) = (0.8)^"~^^M(n — 3) is obtained when xi(n) is delayed by three sam- 
ples. It is plotted in Figure 1.7b. But the function x^in) = (0.8)"u(n — 3) is 
obtained by chopping off the first three samples of xi(n) = (0.8)"m(«), and as 
shown in Figure 1.7c, it is different from X2in). 

1 .3.6 Complex Exponential Function 

The complex exponential sequence is a function that is complex-valued as a 
function of n. The most general form of such a function is given by 

x{n) = Aa", — oo < n < oo (1.14) 

where both A and a are complex numbers. If we let A = |A| e^* and a = 
gi^o+jo^o)^ where ctq, (Oq, and <p are real numbers, the sequence can be expanded 
to the form 

xin)=\A\ej'l'e^'">+j'^^" 
= \A \ e'^ong;(<»on+0) 

= |A| e""" cosicoon + + j \A\ e""" sin(«on + 0) (1.15) 
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Figure 1.7 



Plots of xi{n), X2(n), and x^in). 
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When CTo = 0, the real and imaginary parts of this complex exponential 
sequence are |A| cos(coo« + 0) and \A\ sin(a)o« + </>), respectively, and are real 
sinusoidal sequences with an amplitude equal to \A\. When ctq > 0. the two 
sequences increase as h -> oo and decrease when ctq <0 as n -> oo. When 
a)o = 0 = 0, the sequence reduces to the real exponential sequence \A \ e'^"". 

1.3.7 Properties of cos((<>on) 

When A = 1, and (tq = 0 = 0. we get x{n) = e-''^" = cos(cwo«) + j sin((Wo«). 
This function has some interesting properties, when compared with the 
continuous-time function e^^o' and they are described below. 

First we point out that coq in x{n) = e^^"" is a frequency normalized by /j = 
l/T, where is the sampling frequency in hertz and T is the sampling period 
in seconds, specifically, coq = 27t f^/fs = m'qT, where 0)'^= litf^ is the actual real 
frequency in radians per second and /q is the actual frequency in hertz. Therefore 
the unit of the normalized frequency cdq is radians. It is common practice in 
the literature on discrete-time systems to choose co as the normalized frequency 
variable, and we follow that notation in the following chapters; here we denote 
coq as a constant in radians. We will discuss this normalized frequency again in 
a later chapter. 

Property 1.1 In the complex exponential function x{n) = e-''"^'" , two frequen- 
cies separated by an integer multiple of In are indistinguishable from each 
other. In other words, it is easily seen that e^"^" = e;(<»on+2'r'-) fhg j-g^l part and 
the imaginary part of the function x(n) = e^'^"", which are sinusoidal functions, 
also exhibit this property. As an example, we have plotted xi{n) = cos(0.37rn) 
and X2in) = cos(0.37T +4n)n in Figure 1.8. In contrast, we know that two 
continuous-time functions xi(t) = e^"''^* and X2{t) = e^'^'or their real and imag- 
inary parts are different if coi and (02 are different. They are different even if they 
are separated by integer multiples of In. From the property e-''**" = gji^^on+'^ytr) 
above, we arrive at another important result, namely, that the output of a discrete- 
time system has the same value when these two functions are excited by the 
complex exponential functions e^'^" or e j(.'^''+27ir)^ ^jjj show in Chapter 3 
that this is true for all frequencies separated by integer multiples of In, and 
therefore the frequency response of a DT system is periodic in co. 

Property 1.2 Another important property of the sequence e^^" is that it is 
periodic in n. A discrete-time function x{n) is defined to be periodic if there 
exists an integer N such that x{n + rN) = x(n), where r is any arbitrary integer 
and N is the period of the periodic sequence. To find the value for N such that 

e'"'o" is periodic, we equate e'"'"" to ei^oO'+riV)^ Therefore = ei"o«e./«o'-A'^ 
which condition is satisfied when e^^c^^ = 1, that is, when coqN = 2jtK, where 
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Plot of y(n) 
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Figure 1.8 Plots of cos(0.37rn) and cos(0.3:7r + 4ji)n. 



K is any arbitrary integer. This condition is satisfied by the following equation: 

Mr, K 

— = — (1.16) 

In N 

In words, this means that the ratio of the given normalized frequency cdq and In 
must be a rational number. The period of the sequence is given by 

27tK 

(1.17) 

too 

When this condition is satisfied by the smallest integer K, the corresponding 
value of N gives the fundamental period of the periodic sequence, and integer 
multiples of this frequency are the harmonic frequencies. 



Example 1.1 

Consider a sequence x(n) — cos(0.37r«). In this case coq — 0.3:/r and mq/Itt — 
0.37r/27r = ^. Therefore the sequence is periodic and its period A' is 20 samples. 
This periodicity is noticed in Figure 1.8a and also in Figure 1.8b. 

Consider another sequence x{n) — cos(0.5«), in which case mq — 0.5. There- 
fore coo/2jr = 0.5 /In — I /An, which is not a rational number. Hence this is not 
a periodic sequence. 

When the given sequence is the sum of several complex exponential functions, 
each of which is periodic with different periods, it is still periodic. We consider 
an example to illustrate the method to find the fundamental period in this case. 
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Figure 1.9 Plot of ;c3(n). 



Suppose XT,{n) = cos(0.27rn) + cos(0.5;rM) + cos(0.67r«). Its fundamental 
period must satisfy the condition 

InKi 2itK2 2nK^ 

N = - = - = (1.18) 

Q.ln O.Sn Q.6n 

= lOKi^4K2^^ (1.19) 

where K\, K2, and and A' are integers. The value of that satisfies this 
condition is 20 when Ki — 2, K2 — 5, and = 6. So = 20 is the fundamental 
period of x^in). The sequence x^{n) plotted in Figure 1.9 for 0 < « < 40 shows 
that it is periodic with a period of 20 samples. 



Property 1.3 We have already observed that the frequencies at ojq and at coq + 
27T are the same, and hence the frequency of oscillation are the same. But con- 
sider the frequency of oscillation as coq changes between 0 and 27t. It is found 
that the frequency of oscillation of the sinusoidal sequence cos((Mo«) increases 
as coq increases from 0 to tt and the frequency of oscillation decreases as a>o 
increases from n to 2jt. Therefore the highest frequency of oscillation of a 
discrete-time sequence cos(ftJon) occurs when coq — ±7t. When the normalized 
frequency cdq — 271/^//^ attains the value of n, the value of /g — fJ2. So the 
highest frequency of oscillation occurs when it is equal to half the sampling 
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Plot of y4 = cos(1 .8;rn) 
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Figure 1.10 Plot of cos(tt)on) for different values of coq between 0 and 2n. 



frequency. In Figure 1.10 we have plotted the DT sequences as ojq attains a few 
values between 0 and In, to illustrate this property. We will elaborate on this 
property in later chapters of the book. 

Since frequencies separated by In are the same, as a>Q increases from In to 
371, the frequency of oscillation increases in the same manner as the frequency 
of oscillation when it increases from 0 to tt. As an example, we see that the 
frequency of VQ(n) — cos(0.l7rn) is the same as that of vi{n) — cos(2.l7r7i). It 
is interesting to note that V2{n) — cos(1.97rn) also has the same frequency of 
oscillation as vi(n) because 

V2in) = cos(1.97rn) = cos(2;r - O.lnn) (1.20) 
= cos(27rn) cos(0.l7rn) -|- sin(27rn) sin(0.l7rn) (1-21) 
= cos(0.l7rn) 
= vo(n) 
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vi{n) — cos(2.1:7r«) — cos(27rn + OAitn) (1-22) 
= cos(27rn) cos(0.1:/rn) — sin(27rn) 5\r\{0.\jin) (1-23) 
= cos(O.ln) 
= vo{n) 

We have plotted the sequences v\{n) and W2(«) in Figure 1.11, to verify this 
property. 

Remember that in Chapter 3, we will use the term "folding" to describe new 
implications of this property. We will also show in Chapter 3 that a large class 
of discrete-time signals can be expressed as the weighted sum of exponential 
sequences of the form e^""", and such a model leads us to derive some powerful 
analytical techniques of digital signal processing. 

We have described several ways of characterizing the DT sequences in this 
chapter. Using the unit sample function and the unit step function, we can express 
the DT sequences in other ways as shown below. 

For example, — u(n) — u{n — 1) and u(n) — YlZZ-oo S(m). A mathe- 
matical way of modeling a sequence 

x(n)^\2 3 1.5 0.5 -1 4I (1.24) 
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Figure 1.11 Plots of cos(2.1jrM) and cos(1.97rn). 
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is the weighted sum of shifted unit sample functions, as given by 



xin) = 25(n + 3) + 3S(n + 2) + 1.55(n + 1) + 0.55(n) - Sin - 1) + 4S(n - 2) 

(1.25) 



If the sequence is given in an analytic form x(n) = a"u(n), it can also be 
expressed as the weighted sum of impulse functions: 



In the next chapter, we will introduce a transform known as the z transform, 
which will be used to model the DT sequences in additional forms. We will 
show that this model given by (1.26) is very useful in deriving the z transform 
and in analyzing the performance of discrete-time systems. 



1.4 HISTORY OF FILTER DESIGN 

Filtering is the most common form of signal processing used in all the appli- 
cations mentioned in Section 1.2, to remove the frequencies in certain parts 
and to improve the magnitude, phase, or group delay in some other part(s) of 
the spectrum of a signal. The vast literature on filters consists of two parts: 
(1) the theory of approximation to derive the transfer function of the filter such 
that the magnitude, phase, or group delay approximates the given frequency 
response specifications and (2) procedures to design the filters using the hardware 
components. Originally filters were designed using inductors, capacitors, and 
transformers and were terminated by resistors representing the load and the inter- 
nal resistance of the source. These were called the LC (inductance x capacitance) 
filters that admirably met the filtering requirements in the telephone networks for 
many decades of the nineteenth and twentieth centuries. When the vacuum tubes 
and bipolar junction transistors were developed, the design procedure had to 
be changed in order to integrate the models for these active devices into the 
filter circuits, but the mathematical theory of filter approximation was being 
advanced independently of these devices. In the second half of the twentieth 
century, operational amplifiers using bipolar transistors were introduced and fil- 
ters were designed without inductors to realize the transfer functions. The design 
procedure was much simpler, and device technology also was improved to fabri- 
cate resistors in the form of thick-film and later thin-film depositions on ceramic 
substrates instead of using printed circuit boards. These filters did not use induc- 
tors and transformers and were known as active-RC (resistance x capacitance) 
filters. In the second half of the century, switched-capacitor filters were devel- 
oped, and they are the most common type of filters being used at present for 
audio applications. These filters contained only capacitors and operational ampli- 
fiers using complementary metal oxide semiconductor (CMOS) transistors. They 
used no resistors and inductors, and the whole circuit was fabricated by the 
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very large scale integration (VLSI) technology. The analog signals were con- 
verted to sampled data signals by these filters and the signal processing was 
treated as analog signal processing. But later, the signals were transitioned as 
discrete-time signals, and the theory of discrete-time systems is currently used to 
analyze and design these filters. Examples of an LC filter, an active-/?C filter, 
and a switched-capacitor filter that realize a third-order lowpass filter function 
are shown in Figures 1.12-1.14. 

The evolution of digital signal processing has a different history. At the begin- 
ning, the development of discrete-time system theory was motivated by a search 
for numerical techniques to perform integration and interpolation and to solve 
differential equations. When computers became available, the solution of phys- 
ical systems modeled by differential equations was implemented by the digital 
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Figure 1.12 A lowpass analog LC filter. 




Figure 1.13 An acti\e-RC lowpass analog filter. 



HISTORY OF FILTER DESIGN 



21 



<Pl 01 01 01 



+ 




I ^1 1 

Figure 1.14 A switched-capacitor lowpass (analog) filter. 



computers. As the digital computers became more powerful in their computa- 
tional power, they were heavily used by the oil industry for geologic signal 
processing and by the telecommunications industry for speech processing. The 
theory of digital filters matured, and with the advent of more powerful computers 
built on integrated circuit technology, the theory and applications of digital signal 
processing has explosively advanced in the last few decades. The two revolution- 
ary results that have formed the foundations of digital signal processing are the 
Shannon's sampling theorem and the Cooley-Tukey algorithm for fast Fourier 
transform technique. Both of them will be discussed in great detail in the follow- 
ing chapters. The Shannon's sampling theorem proved that if a continuous-time 
signal is bandlimited (i.e., if its Fourier transform is zero for frequencies above 
a maximum frequency /,„) and it is sampled at a rate that is more than twice 
the maximum frequency /„, in the signal, then no information contained in the 
analog signal is lost in the sense that the continuous-time signal can be exactly 
reconstructed from the samples of the discrete-time signal. In practical applica- 
tions, most of the analog signals are first fed to an analog lowpass filter — known 
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as the preconditioning filter or antialiasing filter — such that the output of the 
lowpass filter attenuates the frequencies considerably beyond a well-chosen fre- 
quency so that it can be considered a bandlimited signal. It is this signal that 
is sampled and converted to a discrete-time signal and coded to a digital signal 
by the analog-to-digital converter (ADC) that was briefly discussed earlier in 
this chapter. We consider the discrete-time signal as the input to the digital filter 
designed in such a way that it improves the information contained in the original 
analog signal or its equivalent discrete-time signal generated by sampling it. A 
typical example of a digital lowpass filter is shown in Figure 1.15. 

The output of the digital filter is next fed to a digital-to-analog converter 
(DAC) as shown in Figure 1.17 that also uses a lowpass analog filter that smooths 
the sampled-data signal from the DAC and is known as the "smoothing filter." 
Thus we obtain an analog signal jdit) at the output of the smoothing filter as 
shown. It is obvious that compared to the analog filter shown in Figure 1.16, the 
circuit shown in Figure 1.17 requires considerably more hardware or involves a 
lot more signal processing in order to filter out the undesirable frequencies from 
the analog signal x(t) and deliver an output signal yd(t). It is appropriate to 
compare these two circuit configurations and determine whether it is possible to 
get the output yd(t) that is the same or nearly the same as the output y{t) shown 
in Figure 1.16; if so, what are the advantages of digital signal processing instead 
of analog signal processing, even though digital signal processing requires more 
circuits compared to analog signal processing? 




Analog 


Analog 


Analog 


Signal 






Input x(t) 


Processor 


Output y(t) 



Figure 1.16 Example of an analog signal processing system. 
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Figure 1.17 Example of a digital signal processing system. 



1 .5 ANALOG AND DIGITAL SIGNAL PROCESSING 

The basic elements in digital filters are the multipliers, adders, and delay ele- 
ments, and they carry out multiplication, addition, and shifting operations on 
numbers according to an algorithm determined by the transfer function of the 
filters or their equivalent models. (These models will be discussed in Chapter 3 
and also in Chapter 7.) They provide more flexibility and versatility compared 
to analog filters. The coefficients of the transfer function and the sample values 
of the input signal can be stored in the memory of the digital filter hardware or 
on the computer (PC, workstation, or the mainframe computer), and by changing 
the coefficients, we can change the transfer function of the filter, while chang- 
ing the sample values of the input, we can find the response of the filter due 
to any number of input signals. This flexibility is not easily available in ana- 
log filters. 

The digital filters are easily programmed to do time-shared filtering under time- 
division multiplexing scheme, whereas the analog signals cannot be interleaved 
between timeslots. Digital filters can be designed to serve as time-varying filters 
also by changing the sampling frequency and by changing the coefficients as a 
function of time, namely, by changing the algorithm accordingly. 

The digital filters have the advantage of high precision and reliability. Very 
high precision can be obtained by increasing the number of bits to represent 
the coefficients of the filter transfer function and the values of the input signal. 
Again we can increase the dynamic range of the signals and transfer function 
coefficients by choosing floating-point representation of binary numbers. The 
values of the inductors, capacitors, and the parameters of the operational amplifier 
parameters and CMOS transistors, and so on used in the analog filters cannot 
achieve such high precision. Even if the analog elements can be obtained with 
high accuracy, they are subject to great drift in their value due to manufacturing 
tolerance, temperature, humidity, and other parameters — depending on the type 
of device technology used — over long periods of service, and hence their filter 
response degrades slowly and eventually fails to meet the specifications. In the 
case of digital filters, such effects are nonexistent because the wordlength of 
the transfer coefficients as well as the product of addition and multiplication 
within the filter do not change with respect to time or any of the environmental 
conditions that plague the analog circuits. Consequently, the reliability of digital 
filters is much higher than that of analog filters, and this means that they are more 
economical in application. Of course, catastrophic failures due to unforeseen 
factors are equally possible in both cases. If we are using computers to analyze. 
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design, and simulate these filters, we can assume even double-precision format 
for the numbers that represent filter coefficients and signal samples. We point 
out that we can carry out the simulation, analysis, and design of any number 
of filters and under many conditions, for example, Monte Carlo analysis, worst- 
case analysis, or iterative optimization to test the design before we build the 
hardware and test it again and again. Of course, we can do the same in the case 
of analog filters or continuous-time systems also (e.g., analog control systems) 
using such software as MATLAB and Simulink.^ During the manufacture of 
analog filters, we may have to tune each of them to correct for manufacturing 
tolerances, but there is no such need to test the accuracy of the wordlength in 
digital filters. 

Data on digital filters can be stored on magnetic tapes, compact disks(CDs), 
digital videodisks (DVDs), and optical disks for an indefinite length of time. 
They can be retrieved without any degradation or loss of data; a good example 
is the music recorded on CDs. In contrast, analog signals deteriorate slowly 
as time passes and cannot be retrieved easily without any loss. There is no 
easy way of storing the transfer function coefficients that defines the analog 
system and feeding the input signals stored on these storage devices to the ana- 
log system. 

By using digital filters, we can realize many transfer functions that cannot be 

realized by analog filters. For example, in addition to those already mentioned 
above, we can realize the following characteristics from digital filters: 

1. Transition bands much smaller than what can be achieved from analog fil- 
ters; an example would be a lowpass filter with a bandwidth of 5000 Hz 
and a passband ripple of 0.5 dB, and 100 dB attenuation above 5010 Hz. In 
spectrum analyzers and synthesizers, vocoders (voice recorders), and simi- 
lar devices, extremely low tolerances on the magnitude and phase responses 
over adjacent passbands are required, and digital filters can be designed to 
meet these specifications. 

2. Finite duration impulse response and filters with linear phase. Neither of 
these characteristics can be achieved by analog filters. Digital filters with 
these characteristics are used extensively in many applications. 

3. Bandwidth of the order 5 Hz or even a fraction thereof that are commonly 
required to process biomedical or seismic signals. 

4. Programmable filters, multirate filters, multidimensional filters, and adap- 
tive filters. Programmable filters are used to adjust the frequency-selective 
properties of the filters. Multirate filters are used in the processing of 
many complex signals with different rates of fluctuation, whereas two- 
dimensional digital filters are the filters used in image processing. Adaptive 
filters are used invariably when the transmission medium between the trans- 
mitter and receiver changes — either as the transmission line is switched to 

^MATLAB and Simulink are registered trademarks of The Math Works, Inc. Natick, MA. The soft- 
ware is available from The MathWorks, Inc. 
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different receivers or as it changes continuously between the transmitter 
and the receiver. For example, when a telephone conversation is switched 
from one point to another and the cable or the microwave link changes, or 
when the mobile phone moves as the talker moves over a wide territory, 
adaptive filters are absolutely necessary to compensate for the distortion of 
the signal as it passes through the transmission Unk. 

5. We have chosen filters only as an example to compare digital and analog 
signal processors. There are many other types of digital signal processing 
that are feasible and are being used, and these are not possible or very effi- 
cient in analog filters. For example, error detection in transmitted signals 
and correction to reduce the error rate is an advanced technique used in 
many applications. Another example is our ability to compress the data by 
a significant factor and receive the input signal at lower cost and very good 
quality. To point out the power of digital signal processing theory and the 
digital signal processors available, let us again consider the mobile phone. 
Bateman and Patterson-Stephans state that "Within the phone, a single DSP 
device may be performing real-time speech compression, video compres- 
sion, echo cancellation, noise cancellation, voice recognition, waveform 
coding, modulation/demodulation, interleaving, multipath equalization, soft 
decision decoding, convolution, automatic frequency-, power- and gain- 
control" [3], and all of them done in a triband phone with TDMA, CDMA, 
and analog signal processing! The mobile phone is just an example to illus- 
trate the large nmnber of digital signal processing techniques that are built 
into any of the appUcations described above. But an application such as 
the mobile phone implements other functions also, and their features are 
briefly described given below. 

1.5.1 Operation of a Mobile Phone Networl^ 

Consider a geographic area in which a part of the mobile phone network operates. 
It is divided into cells as indicated in Figure 1.18. The cells are not really equal 
in area but could be as small as 300 m where the telephone traffic is high and as 
large as 35 km in rural areas. The size and shape of each cell is determined by 
the radiation pattern and the power output of the antenna (and is not hexagonal 
of equal shape and size) serving the mobile phones. A base station controller 
(BSC), usually installed on a tower, serves as many as 124 base transceiver 
stations (BTSs). These stations communicate with all the cell phones that are 
known to be located within the area covered by the cell. The BTSs operate on 
different frequencies, also called "channels," to transmit to and receive signals 
from the cell phones. Global System for Mobile Communication (GSM) is one 
of the most widely used mobile cellular phone network systems in the world, 
and in that system, the frequencies for transmitting from the mobile phone and 
receiving by the BTS lie in the band 890-915 MHz, and the frequencies for 
transmitting from the BTS and receiving by the mobile phone lie in the band 
935-960 MHz. But in order to utilize the frequency spectrum efficiently, cells 
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Figure 1.18 Cell repeat pattern in a mobile network coverage area. 

using the same frequency are kept sufficiently apart so that there is no cochannel 
interference; also the frequencies used in a BTS are separated by 200 kHz. The 
base transceiver stations located on towers over a coverage area are connected by 
fixed digital lines to a mobile switching center (MSC), and the mobile switching 
center is connected to the public switched telephone network (PSTN) as shown 
in Figure 1.19 as well as the Internet, to which other MSCs are also connected. 

When a phone initiates a call to send voice, text, an instant message, or other 
media, it registers with the network via the BTS closest to its location and the 
BTS tracks its location and passes this information to the mobile switching center 
(MSC) over fixed digital lines, which updates this information continuously as 
received from the BTS. Each mobile phone has a home location register (HLR) 
and a visitor location register (VLR) assigned to it. The HLR contains information 
such as the identity of the user and phone number assigned to the user in the 
user's home network, the services to which the user has subscribed, whereas the 
VLR contains information about the mobile phone when it is used outside the 
home network. So when a mobile phone initiates a call, it sends the information 
to the BTS about its identity and so on from the VLR or the HLR depending on 
the location of the phone at the time the call originates. The mobile switching 
center checks the data from its HLR or VLR to authenticate the call and gives 
permission for the phone to access the network. As the caller moves within the 
cell, the BTS monitors the strength of the signal between the phone and the 
receiver, and if this falls below a certain level, it may transfer control of the 
phone to the BTS in the next cell, which may offer a stronger signal. If no such 
cell is nearby, the caller is cut off (i.e., will not be able to receive or to send 
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Figure 1.19 Block diagram of a mobile cell phone network. 



a call). As the caller moves from one ceil to another cell, the BTS serving it 
will transfer control to the BTS in the cell that it has moved to. This is the 
main feature that makes mobile telephony possible. All of these operations are 
carried out by the computers serving the mobile cellular phone network, and that 
technology is known as computer networking technology . It is different from the 
theory of digital signal processing. This textbook offers an introduction to the 
fundamental theory of digital signal processing, which is used in such techniques 
as speech compression, multipath equalization, and echo cancellation, mentioned 
in the previous section. 

There are some disadvantages and limitations in digital signal processing in 
comparison with analog signal processing. By looking at the two circuit config- 
urations in Figures 1.16 and 1.17, it is obvious that the digital signal processor 
is a more complex system, because of the additional components of analog low- 
pass filters (ADC and DAC) on either side of the digital signal processor besides 
the additional control and programming circuits, which are not shown in the 
figures. Another disadvantage is that the digital signal processor can process sig- 
nals within a range of frequencies that is limited mainly by the highest sampling 
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TABLE 1.3 ADCs Currently Available 







Maximum 




Sampling Rate 


Resolution 


Frequency in 




(samples per second) 


(bits) 


Input Signal 


Power 


96,000 


24 


48 kHz 


90 mW 


96,000 


18 


48 kHz 


60 mW 


96,000 


16 


48 kHz 


40 mW 


65,000,000 


14 


500 MHz 


0.6 W 


400,000,000 


8 


1 GHz 


3 W 



frequency of the ADC and DAC that are available. As the frequency is increased, 
the wordlength of these devices decreases and therefore the accuracy and dynamic 
range of the input and output data decrease. 

For example, data on a few ADCs currently available are given in Table 1 .3 [3]. 

Hence digital signal processing is restricted to approximately one megahertz, 
and analog signal processors are necessary for processing signals above that 
frequency, for example, processing of radar signals. In such applications, analog 
signal processing is a more attractive and viable choice, and currently a lot of 
research is being directed toward what is known as mixed-signal processing. Note 
in Table 1.3, that as the resolution (wordlength) for a given signal decreases, the 
power consumption also decreases, but that is just the power consumed by the 
ADCs; the power increases as the sampling frequency increases, even when 
the resolution is decreased. The digital signal processor itself consumes a lot 
more power, and hence additional power management circuits are added to the 
whole system. In contrast, the analog signal processors consume less power. 
The LC filters consume almost negligible power and can operate at frequencies 
in the megahertz range. The active-/?C filters and switched-capacitor filters are 
restricted to the audiofrequency range, but they consume more power than do 
the LC filters. It is expected that mixed-signal processing carried out on a single 
system or a single chip will boost the maximum fi-equency of the signal that can 
be processed, by a significant range, beyond what is possible with a strictly digital 
signal processing system. Therefore we will see more and more applications of 
DSP with increasing frequencies because the advantages of DSP outweigh the 
disadvantages in analog signal processing. 



1.6 SUMMARY 

In this introductory chapter, we defined the discrete-time signal and gave a few 
examples of these signals, along with some simple operations that can be applied 
with them. In particular, we pointed out the difference between a sinusoidal 
signal, which is a continuous-time signal, and a discrete-time signal. We dis- 
cussed the basic procedure followed to sample and quantize an analog signal 
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and compared the advantages and disadvantages of digital signal processing with 
those of directly processing the analog signal through an analog system, tak- 
ing a filter as an example. In doing so, we introduced many terms or acronyms 
that we have not explained. Some of them will be explained in great detail in 
the following chapter. In Chapter 2 we will discuss several ways of modeling 
a discrete-time system and the methods used to find the response in the time 
domain, when excitation is effected by the discrete-time signals. 



PROBLEMS 

1.1 Given two discrete-time signals xi(«) = {0.9 0.5 0.8 I.O 1.5 2.0 

t 

0.2} and xiin) = {1.0 0.3 0.6 0.4}, sketch each of the following: 
t 

(a) yiin) = xiin) + 3x2 (n) 

(b) y2(n) = xi(n) - xjin - 5) 

(c) yj,(n) = xi(n)x2(n) 

(d) y4{n) = xi(-n+4) 

(e) ysin) = yA{n)x2{n) 

(f) y^{n) = X2{-n - 3) 

(g) yiin) = y4in)y6in) 

1.2 Sketch each of the following, where xi (n) and X2(n) are the DT sequences 
given in Problem 1.1: 

(a) viin) = Xi{n)x2i4 — n) 

(b) V2in) = ZZ-oc xi(k)x2{n - k) 

(c) Vi{n) = Eil-(x)-^2(fc)-J:i(« - k) 

(d) v4(n) = E:::o"^i(«) 

(e) v^in) = xiiln) 

1.3 Repeat Problem 1. 1 with jci(«) = (1.0 0.8 0.2 -0.2 -0.5 

- 0.7} and X2(n) = {0.5 0.2 0.1 0.2 0.6}. 

t 

1.4 Repeat Problem 1.2 with xi{n) and X2{n) as given in Problem 1.3. 

1.5 Find the even and odd parts of x\in) and X2{n) given in Problem 1.1. 
Even part of xiin) is defined as {x\{n) + xi(—n)]/2, and the odd part as 
[xiin) -xi(-n)]/2 

1.6 Repeat Problem 1.5 with xi{n) and X2in) as given in Problem 1.3. 

1.7 Find Si (k) = X;"!^ n and sketch it, for A: = 0, 1 , ... 5. 

1.8 Find and sketch S2(k) = EL-oo (") S^ik) = E^=-oo -^zCn), where 
xi{n) and X2{n) are as given in Problem I.I. 
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1.9 Repeat Problem 1.8 with xi{n) and X2in) as given in Problem 1.3. 

1.10 Express the sequences xiin) and X2(n) as a summation of weighted and 
shifted unit step functions, where JCi(n) and JC2(n) are as given in Prob- 
lem 1.1. 

1.11 Repeat Problem 1.10 with the sequences xi{n) and X2(n) given in Prob- 
lem 1.3. 

1.12 Given x(n) = [O-Se-'^'^/^^f [m(«) - M(n - 4)], calculate the values of 
\x(n)\ and sketch them. What are the real and imaginary parts of x(n)? 

1.13 Express the real and imaginary parts of x(n) = X!l=o[*^-5^''^"^*^]* 
Sin - k). 

1.14 What are the real and imaginary parts of qin) = Y!^^oi0.3 - yO.4)"? 

1.15 What is the fundamental period of piin) = e^^-^^"? 

1.16 Find the fundamental period of p2in) = e'^-'^'"' + 2e-'°-^"". 

1.17 Find the fundamental period of p^in) = cos(0.5;rn) -|- 4cos(2.5;rn). 

1.18 What is the fundamental period of pA{n) = cos(0.2;rn) -|- cos(0.7n^n) -|- 

cos(7rn)? 

1.19 Find the fundamental period of p^in) — cos(0.5n) + 3cos(0.2n). 

1.20 Find the fundamental period of pein) = P\{n)p2{n), where pi{n) and 
Piin) are as given above. 

1.21 Find the fundamental period of p-i{n) = cos(1.27rn) -|- 4sin(0.27Tn). 

1.22 What is the fundamental period of p^{n) = cos{<d.\nn)p-i{n)l 

1.23 The sinusoidal sequence h{n) = A cos{coQn + 4>) has the following values 
over one period; find the values of A, (oq and <p: 

h{n) = {2.00 0.00 - 2.00 - 0.00} 
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CHAPTER 2 



Time-Domain Analysis 
and z Transform 



2.1 A LINEAR, TIME-INVARIANT SYSTEM 

The purpose of analysis of a discrete-time system is to find the output in either 
the time or frequency domain of the system due to a discrete-time input signal. In 
Chapter 1, we defined the discrete-time signal as a function of the integer variable 
n, which represents discrete time, space, or some other physical variable. Given 
any integer value in — oo < n < oo, we can find the value of the signal according 
to some well-defined relationship. This can be described as a mapping of the set 
of integers to a set of values of the discrete-time signal. Description of this 
relationship varied according to the different ways of modeling the signal. In this 
chapter, we define the discrete-time system as a mapping of the set of discrete- 
time signals considered as the input to the system, to another set of discrete-time 
signals identified as the output of the system. This mapping can also be defined 
by an analytic expression, formula, algorithm, or rule, in the sense that if we 
are given an input to the system, we can find the output signal. The mapping 
can therefore be described by several models for the system. The mapping or 
the input- output relationship may be linear, nonlinear, time-invariant, or time- 
varying. The system defined by this relationship is said to be linear if it satisfies 
the following conditions. 

Assume that the output is y{n) due to an input x{n) according to this rela- 
tionship. If an input Kx{n) produces an output Ky{n), the system satisfies the 
condition of homogeneity, where K is any arbitrary constant. Let K\y\{n) and 
Kiy^in) be the outputs due to the inputs Kixi{n) and K2X2{n), respectively, 
where K\ and K2 are arbitrary constants. If the output is K\y\{n) -\- K2y2{n) 
when the input is K\yi{n) + K2y2(n), then the system satisfies the superposition 
property. A system that satisfies both homogeneity and superposition is defined as 
a linear system. If the output is yin — M) when the input is delayed by M sam- 
ples, that is, when the input is x(m — M), the system is said to be time -invariant 
or shift-invariant. If the output is determined by the weighted sum of only the 
previous values of the output and the weighted sum of the current and previous 
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values of the input, then the system is defined as a causal system. This means 
that the output does not depend on the future values of the input. We will discuss 
these concepts again in more detail in later sections of this chapter. In this book, 
we consider only discrete-time systems that are linear and time-invariant (LTI) 
systems. 

Another way of defining a system in general is that it is an interconnection 
of components or subsystems, where we know the input-output relationship of 
these components, and that it is the way they are interconnected that determines 
the input-output relationship of the whole system. The model for the DT system 
can therefore be described by a circuit diagram showing the interconnection of 
its components, which are the delay elements, multipliers, and adders, which are 
introduced below. In the following sections we will use both of these definitions 
to model discrete-time systems. Then, in the remainder of this chapter, we will 
discuss several ways of analyzing the discrete-time systems in the time domain, 
and in Chapter 3 we will discuss frequency-domain analysis. 

2.1 .1 Models of the Discrete-Time System 

First let us consider a discrete-time system as an interconnection of only three 
basic components: the delay elements, multipliers, and adders. The input-output 
relationships for these components and their symbols are shown in Figure 2.1. 
The fourth component is the modulator, which multiplies two or more signals 
and hence performs a nonlinear operation. 

A simple discrete-time system is shown in Figure 2.2, where input signal 
x(n) = {x{0), x(l), x(2), x{3)} is shown to the left of vq(h) — x(n). The signal 



Delay Element Xi(n) — >- ^-1 — >■ Yi(n) = Xi(n- 1) 



Multiplier 




Adder 




Modulator 




me(n) 



Figure 2.1 The basic components used in a discrete-time system. 
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X(n) 

x(0) 
T x(3) 
x(1) t 
Tx(2) 




Figure 2.2 Operations in a typical discrete-time system. 



vi(n) shown on the left is the signal x(n) delayed by T seconds or one sam- 
ple, so, vi(n) — x{n — 1). Similarly, v(2) and v(3) are the signals obtained 
from x{n) when it is delayed by 27 and 3T seconds: V2{n) = x(n — 2) and 
Viin) = x(n — 3). When we say that the signal x(n) is delayed by T, 2T, or 3T 
seconds, we mean that the samples of the sequence are present T, 2T, or 3T 
seconds later, as shown by the plots of the signals to the left of vi(n), V2{n), 
and v^in). But at any given time t = nT, the samples in v\{n), viin), and U3(n) 
are the samples of the input signal that occur T, IT, and 3T seconds previous to 
t — nT. For example, att = 3T, the value of the sample in x{n) is x(3), and the 
values present in vi{n), V2(n) and vsin) are x(2), x(l), and x(0), respectively. 
A good understanding of the operation of the discrete-time system as illustrated 
above is essential in analyzing, testing, and debugging the operation of the sys- 
tem when available software is used for the design, simulation, and hardware 
implementation of the system. 

It is easily seen that the output signal in Figure 2.2 is 



y{n) = b{0)v(0) + Hl)vil) + b(2)vi2) + bi3)v(3) 

= b(0)xin) + b(l)x{n - 1) + b{2)x(n - 2) + b{3)x{n - 3) 
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Figure 2.3 Schematic circuit for a discrete-time system. 



where b{0), b(l), b{2), b(3) are the gain constants of the multiphers. It is also 
easy to see from the last expression that the output signal is the weighted sum of 
the current value and the previous three values of the input signal. So this gives 
us an input-output relationship for the system shown in Figure 2.2. 

Now we consider another example of a discrete-time system, shown in 
Figure 2.3. Note that a fundamental rule is to express the output of the adders 
and generate as many equations as the number of adders found in this circuit 
diagram for the discrete-time system. (This step is similar to writing the node 
equations for an analog electric circuit.) Denoting the outputs of the three adders 
as yi(n), y2(n), and y3,(n), we get 

yiin) = 0.3yi(« - 1) - 0.2yi(n - 2) - OAx(n - 1) 

yiin) = yi(n) + 0.5yi(n - 1) - 0.4y2(« - 1) 

y^in) = y2(n) + 0.6y2{n - 1) + 0.8yi(n) (2.1) 

These three equations give us a mathematical model derived from the model 
shown in Figure 2.3 that is schematic in nature. We can also derive (draw 
the circuit realization) the model shown in Figure 2.3 from the model given in 
Equations (2.1). We will soon describe a method to obtain a single input-output 
relationship between the input x{n) and the output y{n) — yiin), after eliminat- 
ing the internal variables >>](«) and yiin); that relationship constitutes the third 
model for the system. The general form of such an input-output relationship is 



N M 

yin) = - ^aik)yin - k) + ^bik)xin - k) ill) 

k=\ k=0 
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or in another equivalent form 

N M 

Y^a{k)y{n - k) = Y^b{k)x{n - k); a(0) = 1 (2.3) 

Equation (2.2) shows that the output y{n) is determined by the weighted sum 
of the previous values of the output and the weighted sum of the current and 
previous M + \ values of the input. Very often the coefficient a(0) as shown in 
(2.3) is normalized to unity. 

Soon we will introduce the z transform to represent the discrete-time signals 
in the set of equations above, thereby generating more models for the system, and 
from these models in the z domain, we will derive the transfer function H(zr^) 
and the unit sample response or the unit impulse response h(n) of the system. 
From any one of these models in the z domain, we can derive the other models in 
the z domain and also the preceding models given in the time domain. It is very 
important to know how to obtain any one model from any other given model 
so that the proper tools can be used efficiently, for analysis of the discrete-time 
system. In this chapter we will elaborate on the different models of a discrete- 
time system and then discuss many tools or techniques for finding the response of 
discrete-time systems when they are excited by different kinds of input signals. 

2.1.2 Recursive Algorithm 

Let us consider an example of Equation (2.2) as y{n) = y{n — 1) — 0.25>'(n — 
2) -|- x(n), where the input sequence x(n) = S(n), and the two initial conditions 
are ^(-1) = 1.0 and y(-2) ^ 0.4. 

We compute ^(0), ^(l), y(2), ... in a recursive manner as follows: ^(0) = 
y{-l) - 0.25>'(-2) -f jc(0). Since x(n) = S(n), we substitute x{0) = 1 and get 
);(0) = 1.0-0.25(0.4) + 1 = 1.9. Next };(1) = ^(0) - 0.25y(-l) + jc(1). We 
know y(0) = 1.9 from the step shown above, and also that x{l) = 0. So 
we get ^(l) = 1.9 — 0.25(1.0) + 0 = 1.65. Next, for n = 2, when we compute 
y(2) = y{l) — 0.25_y(0) -|- x(2). Substituting the known values from above, we 
get y(2) = 1.65 - 0.25(1.9) + 0= 1.175. 

Next, when n = 3, we obtain 

3;(3) = j(2)-0.25);(l)+x(3) 

= 1.175 - 0.25(1.65) + 0 = 0.760 

We can continue to calculate the values of the output y(n) for « = 4, 5, 6, 7, 

This is known as the recursive algorithm, which we use to calculate the output 
when we are given an equation of the form (2.2); it can be used when there is 
any other input. For a system modeled by an equation of the form (2.2), the 
output is infinite in length in general. As a special case, when the input is the 
unit impulse function S{n), and the initial conditions are assumed to be zero, the 
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resulting output is called the unit impulse response h{n) (or more appropriately 
the unit sample response) and is infinite in length. 

Consider a system in which the multiplier constants a{k) = 0 for k = 
1,2,3, N. Then Equation (2.2) reduces to the form 

M 

y{n) = Y^b{k)x{n - k) (2.4) 

= biO)xin) + bil)xin - 1) + fe(2)x(« - 2) + • • • + b{M)x{n - M) 

Let us find the unit impulse response of this system, using the recursive algo- 
rithm, as before: 

y{0) = b{Q){\) + 0 + 0 + 0+ -- - = ^(0) 
^(1) = b{<d)x(l) + ^^(l)x(O) + b{2)x{- 1) + 0 + 0 + • • 
y{2) = b{Q)x(2) + ^(l)x(l) + b{2)x{0) + 0 + 0 + 0 + 

Continuing this procedure recursively, we would get 

y{3) = b{3) 
y{4) = b{4) 

yiM) = b{M) 

This example leads to the following two observations: (1) the samples of the unit 
impulse response are the same as the coefficients bin), and (2) therefore the unit 
impulse response h(n) of the system is finite in length. 

So we have shown without proof but by way of example that the unit impulse 
response of the system modeled by an equation of the form (2.2) is infinite in 
length, and hence such a system is known as an infinite impulse response (IIR) 
filter, whereas the system modeled by an equation of the form (2.4), which has 
an unit impulse response that is finite in length, is known as the finite impulse 
response (FIR) filter. We will have a lot more to say about these two types of 
filters later in the book. Equation (2.3) is the ordinary, linear, time-invariant, 
difference equation of A^th order, which, if necessary, can be rewritten in the 
recursive difference equation form (2.2). The equation can be solved in the time 
domain, by the following four methods: 

1. The recursive algorithm as explained above 

2. The convolution sum, to get the zero state response, as explained in the 
next section 



■ = b(l) 
■■■= b{2) 
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3. The classical method of solving a difference equation 

4. The analytical solution using the z transform. 

We should point out that methods 1-3 require that the DT system be modeled by a 
single-input, single-output equation. If we are given a large number of difference 
equations describing the DT system, then methods 1-3 are not suitable for finding 
the output response in the time domain. Method 4, using the z transform, is the 
only powerful and general method to solve such a problem, and hence it will be 
treated in greater detail and illustrated by several examples in this chapter. Given 
a model in the z-transform domain, we will show how to derive the recursive 
algorithm and the unit impulse response h{n) so that the convolution sum can be 
applied. So the z-transform method is used most often for time-domain analysis, 
and the frequency-domain analysis is closely related to this method, as wiU be 
discussed in the next chapter. 

2.1.3 Convolution Sum 

In the discussion above, we have assumed that the unit impulse response of a 
discrete-time system when it is excited by a unit impulse function &{n), exists 
(or is known), and we denote it as h{n). Instead of using the recursive algo- 
rithm to find the response due to any input, let us represent the input sig- 
nal x{n) not by its values in a sequence {x(0), x{\), x{2), x(3),...} but as 
the values of impulse function at the corresponding instants of time. In other 
words, we consider the sequence of impulse functions x(0)5(n), x{\)8{n — 1), 
x(2)3(n — 2), . . . as the input — and not the sequence of values {x(0), x{\), 
x{2), x(3), . . .}. The difference between the values of the samples as a sequence 
of numbers and the sequence of impulse functions described above should be 
clearly understood. The first operation is simple sampling operation, whereas the 
second is known as impulse sampling, which is a mathematical way to repre- 
sent the same data, and we represent the second sequence in a compact form: 
x{n) = Y^f^Qx(k)8(n — k). The mathematical way of representing impulse sam- 
pling is a powerful tool that is used to analyze the performance of discrete-time 
systems, and the values of the impulse functions at the output are obtained by 
analytical methods. These values are identified as the numerical values of the 
output signal. 

Since h{n) is the response due to the input S{n), we have x(0)h(n) as the 
response due to x(0)S(n) because we have assumed that the system is linear. 
Assuming that the system is time-invariant as well as linear, we get the output 
due to an input xil)S{n — 1) to be x(l)h(n — 1). In general, the output due to 
an input x(k)S(n — k) is given by x(k)h(n — k). Adding the responses due to all 
the impulses in x(n) = X!^o-*(^)^(" ~ S^t the total output as the sum 



oo 




(2.5) 
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This is known as the convolution sum, denoted by a compact notation y{n) = 
x{n) *hin). The summation formula can be used to find the response due to any 
input signal. So if we know the unit impulse response h(n) of the system, we 
can find the output y(n) due to any input x{n) — therefore it is another model 
for the discrete-time system. In contrast to the recursive algorithm, however, 
note that the convolution sum cannot be used to find the response due to given 
initial conditions. When and if the input signal is defined for — oo < n < oo or 
— M < n < oo, obviously the lower index of summation is changed to — oo. In 
this case the convolution sum formula takes the general form 



For example, even though we know that h(n) = 0 for — oo < n < 0, if the input 
sequence x(n) is defined for —M < n < oo, then we have to use the formula 
y(n) = X!^-oo x{k)h{n — k). Ifxin) = 0 for — oo < n < 0, then we have to use 
the formula y(n) = Y^'^=ox{k)h{n — k). 

To understand the procedure for implementing the summation formula, we 
choose a graphical method in the following example. Remember that the recur- 
sive algorithm cannot be used if the DT system is described by more than one 
difference equation, and the convolution sum requires that we have the unit pulse 
response of the system. We will find that these limitations are not present when 
we use the z-transform method for analyzing the DT system performance in the 
time domain. 

Example 2.1 

Given an h{n) and x{n), we change the independent variable from n io k and 
plot hik) and x{k) as shown in Figure 2.4a,b. Note that the input sequence is 
defined for —2 <k<5 but h{k) is a causal sequence defined for 0 < fc < 4. Next 
we do a time reversal and plot h{—k) in Figure 2.4c. When n > 0, we obtain 
h(n — k) by delaying (or shifting to the right) h(—k) by n samples; when n < 0, 
the sequence h{—k) is advanced (or shifted to the left). For every value of n, 
we have h(n — k) and x{k) and we multiply the samples of h(n — k) and x{k) 
at each value of k and add the products. 

For our example, we show the summation of the product when n = — 2 in 
Figure 2.4d, and show the summation of the product when n = 3 in Figure 2.4e. 
The output y{—2) has only one nonzero product - x(— 2)/z(0). But the output 
sample ^(3) is equal to a;(0)/i(3) -I- x{\)h{l) + x{l)h{\) + x(3)/i(0). 

But note that when n > 9, and n < —2, the sequences h{n — k) and x{k) do 
not have overlapping samples, and therefore y{n) = 0 for n > 9 and n < —2. 

Example 2.2 

As another example, let us assume that the input sequence x(n) and also the 
unit impulse response h(n) are given for 0 < n < oo. Then output y{n) given 



oo 




(2.6) 
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X(k) 



h(-2 - k): 



(a) 



I I I I 

-5^-3-2-1 0 1 2 

id) 

h(3 - k) 



-10 1 2 3 

(e) 



h(10-k) 



h(k) 



h{- k) 



(c) 



(0 

Figure 2.4 Convolution sum explained. 

by (2.5) can be computed for each value of n as shown below: 
yiO) = x(0)/j(0) 
y(l) ^ x(OMl) + x(l)h(0) 
y{2) = jc(0)/j(2) + x(l)hil) + x(2)h(0) 
y{3) = x{0)h(3) +x{l)h{2) +xi2)h{l) + x(3)h(0) 
y{4) = jc(0)/i(4) +xil)h{3) + x{2)h{2) + x(3)h{l) +xi4)h(0) 



yin) = x(0)hin)+x(l)hin - l)+x(2)hin - 2)+x(3)h(n - 3) + - ■ ■+xin)h(0) 
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It is interesting to note the following pattern. In the expressions for each 
value of the output y{n) above, we have xiO), x{l), x{2) . . . and h{n), h(n — 1), 
h(n — 2) . . . muhiphed term by term in order and the products are added, while 
the indices of the two samples in each product always add to n. 

Convolution is a fundamental operation carried out by digital signal processors 
in hardware and in the processing of digital signals by software. The design of 
digital signal processors and the software to implement the convolution sum 
have been developed to provide us with very efficient and powerful tools. We 
will discuss this subject again in Section 2.5, after we learn the theory and 
application of z transforms. 

2.2 z TRANSFORM THEORY 

2.2.1 Definition 

In many textbooks, the z transform of a sequence x{n) is simply defined as 

00 

Z[xin)] = X{z) = J2 ^(«)^~" (2.8) 

n=— 00 

and the inverse z transform defined as 

Z-'[Xiz)] = x(n) = f X(z)z"-'dz (2.9) 
27rj Jc 

Equation (2.8) represents the (double-sided or) bilateral z transform of a sequence 
x{n) defined for — oo < n < oo. The inverse z transform given in (2.9) is obtained 
by an integration in the complex z plane, and this integration in the z plane is 
beyond the scope of this book. 

We prefer to consider signals that are of interest in digital signal processing 
and hence consider a sequence obtained by sampling a continuous-time signal 
x{t) with a constant sampling period T (where T is the sampling period), and 
generate a sequence of numbers x{nT). Remember that according to the sifting 
theorem, we have x(t)S{t) = x(0)S(t). We use this result to carry out a proce- 
dure called impulse sampling by multiplying xit) with an impulse train p{t) = 
YlT=o 8(1 — nT). Consequently we consider a sequence of delayed impulse func- 
tions weighted by the strength equal to the numerical values of the signal instead 
of a sequence of numbers. By doing so, we express the discrete sequence as a 
function of the continuous variable t, which allows us to treat signal processing 
mathematically. The product is denoted as 

oo 

x*it) = J2^(t)8it -nT) 

n=0 

oo 

= Y^x{nT)8{t - nT) (2.10) 

n=0 
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This expression has a Laplace transform denoted as 

oo 

Z*(i) = ^x(nr)e-'"^ (2.11) 

Now we use a frequency transformation e*^ = z, (where z is a complex variable), 
and substituting it in expression (2.11), we get 

oo 
«=0 

Since T is a constant, we consider the samples x(nT) as a function of n and 
obtain the z transform of x{n) as 



^*WL.7=, = ^x(nr)z-" 

n=0 

oo 

X(z) = ^x(«)z-" (2.12) 

Although the first definition of a discrete sequence given in (2.8) is devoid of 
any signal concepts, soon concepts such as frequency response and time-domain 
response are used in the analysis of discrete-time systems and signal processing. 
Our derivation of the z transform starts with a continuous-time signal that is sam- 
pled by impulse sampling and introduces the transformation e*^ = z to arrive at 
the same definition. In Chapter 3, we will study the implication of this transfor- 
mation in more detail and get a fundamental understanding of the relationship 
between the frequency responses of the continuous-time systems and those of 
the discrete-time systems. Note that we consider in this book only the unilateral 
z transform as defined by (2.12), so we set the lower index in the infinite sum 
as n = 0. 

Example 2.3 

Let us derive the z transform of a few famiUar discrete-time sequences. Consider 
the unit pulse 



5(n) = 



1 n = 0 
0 n^O 



There is only term in the z transform of S(n), which is one when n = 0. Hence 

Z[8m = L 
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Example 2.4 

Consider the unit sample sequence u{n) 



f 1 for n > 0 
"^"^=|o forn<0 ^2.13) 

From the definition of the z transform, we get 

Z[uin)] = I + z-^ + z'^ + z'^ + ■ ■ ■ (2.14) 

00 

This is an infinite series that converges to a closed-form expression (2.16), only 
when I < 1, or |z| > 1. This represents the region outside the unit circle in 
the z plane and it is called the region of convergence (ROC). This means that 
the closed-form expression exists only for values of z that lie in this region: 

E^"" = -r^ = ^ (2.16) 

1 - z ' z - 1 

n=0 

It is obvious that the region of convergence for the z transform of S(n) is the 
entire z plane. 

Example 2.5 

Let x(n) — a"u(n), where a is assumed to be a complex number in general. 
From the definition for the z transform, we obtain 

00 00 

X(z) = ^a"z-« = ^(az-T (2-lV) 

«=0 n=0 

This power series converges to (2.18), when |az~'| < 1, that is, when |z| > \a\. 
This shows that the region of convergence for the power series is outside the 
circle of radius R = a. It is important to know the region of convergence in 
which the closed-form expression for the z transform of a sequence of infinite 
length is valid. ^ 

Xiz) = . ^ , = (2.18) 
1 — az" z — a 



'it can be shown that the z transform for the anticausal sequence /(n) = — q'"m(— n — 1) is F(z) = 
J2n=-co «"z~"> which also converges to z/(z — a), which is the same as X(z) in (2.18), but its ROC 
is Izl < 0!. So the inverse z transform of a function is not unique; only when we know its ROC does 
the inverse z transform become unambiguous. 
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Example 2.6 

Let us consider another example, x{n) = e-'^"u(n), which is a complex- valued 
sequence. Its z transform is 



oo ^ 

^ 1 - e3^z~^ 

n=0 



(2.19) 



and its region of convergence is the region outside the unit circle in the z plane: 
Izl > 1. 

Example 2.7 



Given a sequence x{n) = r" cos{On)u(n), where 0 < r < 1, to derive its z trans- 
form, we express it as follows: 



x(n) = r" 



' gjSn _|_ g-jdrf 



2 



2 
+ 



u{n) 



u(n) 



uin) -\ u(n) 



(2.20) 



Now one can use the previous results and obtain the z transform of x(n) = 
r" cos{6n)u{n) as 



Xiz) = 



z(z - r co&(9)) 
z^ - (2r cos(0))z -I- r2 



(2.21) 



and its region of convergence is given by |z| > r. Of course, if the sequence 
given is x{n) = e'"" cos{a>on)u{n), we simply substitute e'" for r in (2.21), 
to get the z transform of x(n). It is useful to have a list of z transforms for 
discrete-time sequences that are commonly utilized; they are listed in Table 2.1. 
It is also useful to know the properties of z transforms that can be used to 
generate and add more z transforms to Table 2.1, as illustrated by the following 
example. 



Property 2.1: Differentiation If Z(z) is the z transform of x{n)u{n), 
—z{dX{z)\/dz is the z transform of nx{n)u{n). We denote this property by 



nx{n)u{n) 



—z- 



d Xjz) 
dz 



(2.22) 
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TABLE 2.1 List of z-Transform Pairs 



x(n), for « > 0 X(z) 



1 S(n) 1 

2 S(n — m) z 

3 u(n) 



4 au{ri) 

5 a" 

6 na" 
7 

8 «3 

9 n^a" 



10 

2! 



J J n(ra - l)(n - 2) (n - m + 2) 

(m - 1)! 

12 r"e-''^" 

13 r« cosC^n) 

14 r" sinCe^n) 

15 cos(6ln) 



z 


z - 


1 


az 




z — 


1 


z 





z — a 

az 
{Z - af 
z(z + 1) 
(z - 1)3 
z(z^ + 4z + 1) 

(z - 1)' 
az(z + a) 



(z 


-a)3 




z 


(z- 


-a)3 




z 


(z- 


-a)" 




z 



Z — re-/^ 

z(z - r cos(e)) 
Z^ - (2r cos(9))z + r2 

rz sin(0) 
z^ - (2r cos(6>))z + r2 
z(z-e-" cos(e)) 
^2 _ (26-" cos(6l))z + e-2« 



Proof: X(z) = l]^o^(")^ Differentiating both sides with respect to z, 
we get 

^ «=0 n=0 

— z — ; — = 7 Mx(n)z~" = ^[nx(n)M(n)] 
dz ^ 

n—O 
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Now consider the z transform given by (2.18) and also listed in Table 2.1: 

x(n) = a"u{n) = X{z) (2.23) 

z — a 

Using this differentiation property recursively, we can show that 

nv 

na"uin) ^ (2.24) 

(z - ay 



and 



nVu{n) <{=^ — -f (2.25) 

(z - ay 



From these results, we can find the z transform of j{n + l)(n + 2)a"u(n) = 



i(n^ + 3n + 2)a"u{n) as follows: 



+ l)(n + 2)a"u{n) ^ (2.26) 
2 (z - ay 

The transform pair given by (2.26) is an addition to Table 2.1. Indeed, we can 
find the z transforms of n^a"u{n), n'^a"u{n), . . . , using (2.22) and then find the 
z transforms of 

^(n + l)(n + 2)(n + 3)a"u{n) 

^(n + l)(n + 2)(n + 3)(n + 4)a"uin) (2.27) 
4! 



which can be added to Table 2.1. 

Properties of z transform are useful for deriving the z transform of new 

sequences. Also they are essential for solving the linear difference equations and 
finding the response of discrete-time systems when the input function and initial 
conditions are given. Instead of deriving all the properties one after another, as is 
done in many textbooks, we derive one or two at a time and immediately show 
their applications. 

Property 2.2: Delay Lettheztransformofx(n)M(n)beZ(z) = l]^o^(")^" — 
x(0) + x(l)z-' + x(2)z-2 + x(3)z-3 + . . . . 

Then the z transform of x(n — l)u{n — 1) is z~^X{z) +x(—l): 



xin - l)M(n - 1) z'^Xiz) + xi-l) 



(2.28) 
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Proof: The z transform of x(n — l)M(n — 1) is obtained by shifting to the 
right or delaying x{n)u{n) by one sample, and if there is a sample x{—\) at 
n = — 1, it will be shifted to the position n = 0. The z transform of this delayed 
sequence is therefore given by 

x{-\) + x(Qi)z~^ + x(l)z-2 + Jc(2)z-3 + ■ ■ ■ 

= x(-l) + z-' [x(0)+a;(1)z-i + x{2)z-^ + ■ ■ ■] 
= x{-\) + z-^X{z) 
By repeated appUcation of this property, we derive 

x{n - 2)u{n - 2) ^ z~^X{z) + z~^x{-\) + x{-2) (2.29) 
xin - 3)u(n - 3) ^ z~'Z(z) + z'^xi-l) + z~^x(-2) + jc(-3) (2.30) 

and 

x(n - m)u{n - m) <^ z'^^Xiz'^) + z~"'"'^x{-\) + z"'"+^x(-2) 
H h x{—m) 

or 

m— 1 

x(n - m)u{n - m) -^=^ z~'"X(z) + ^ x(n - m)z~" (2.31) 

n=0 

If the initial conditions are zero, we have the simpler relationship 

x{n - m)u{n - m) z"'"X(z) (2.32) 

Example 2.8 

Let us consider an example of solving a first-order linear difference equation 
using the results obtained above. We have 

yin) - 0.5y(n - 1) = 5x(n - 1) (2.33) 

where 

xin) = (0.2)" m(«) 

yi-i) = 2 

Let Z[y(n)] = Yiz). From (2.28), we have Z[y(n - I)] = z~^Y(z) + y(-l) 
mdZ[x(n - 1)] = z"'Z(z) + x(-l) where X(z) = z/(z - 0.2) andA;(-l) = 0, 
since xin) is zero for — oo < n < 0. Substituting these results, we get 

Yiz) - 0.5 [z-'Yiz) + yi-D] = 5 [z-'Z(z) + x(-l)] 
Yiz) - 0.5 [z-^Yiz) + yi-l)] = Sz'^Xiz) 
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Yiz) [1 - 0.5z-'] = 0.5y(-l) + 5z-^X(z) (2.34) 



(z - 0.5) (z - 0.5) 
Substituting >»(— 1) = 2 and Z(z) = z/iz — 0.2) in this last expression, we get 



Yiz) = 



+ 



5z 



(z-0.5) (z-0.5)(z-0.2) 
= Yoi{z) + Yosiz) 



(2.35) 
(2.36) 



where Yoiiz) is the z transform of the zero input response and Yos(z) is the 
z transform of the zero state response as explained below. 

Now we have to find the inverse z transform of the two terms on the right 
side of (2.35). The inverse transform of the first term FoKz) = z/iz — 0.5) is 
easily found as yoi(n) = (0.5)"u(n). Instead of finding the inverse z transform 
of the second term by using the complex integral given in (2.9), we resort to 
the same approach as used in solving differential equations by means of Laplace 
transform, namely, by decomposing Yq^ (z) into its partial fraction form to obtain 
the inverse z transform of each term. We have already derived the z transform of 
Ra"u{n) as Rz/iz — a), and it is easy to write the inverse z transform of terms 
like RkZ/iz — a^). Hence we should expand the second term in the form 



Riz 



+ 



Riz 



z-0.5 z - 0.2 



(2.37) 



by a slight modification to the partial fraction expansion procedure that we are 
familiar with. Dividing 7os iz) by z, we get 

Ypsiz) ^ 5 _ I ^2 

z (z - 0.5)(z - 0.2) z-0.5 z-0.2 



Now we can easily find the residues R\ and R2 using the normal procedure and 
get 



R\ = (z - 0.5) 



„ Yos (z) 

R2 = iz - 0.2) 



z=o.5 a -0-2) 
5 



= 16.666 



z=0.5 



:=0.2 (Z - 0.5) 



= -16.666 



Z=0.2 



Therefore 



Yosiz) 



16.666 16.666 



(z - 0.5)(z - 0.2) z-0.5 z - 0.2 



z TRANSFORM THEORY 49 



Multiplying both sides by z, we get 

^ 16:666z _ 16^ 
z-0.5 z-0.2 

Now we obtain the inverse z transform >'os(n) = 16.666[(0.5)" — (0.2)"]M(n). 
The total output satisfying the given difference equation is therefore given as 

y{n) = y^iin) + y^An) = {(0.5)" + 16.666[(0.5)" - (0.2)"]} u{n) 
= {17.6666(0.5)" - 16.666(0.2)"} M(n) 

Thus the modified partial fraction procedure to find the inverse z transform of 
any function F(z) is to divide the function F(z.) by z, expand F(z)/z into its 
normal partial fraction form, and then multiply each of the terms by z to get 
F(z) in the form X!;fc=i ^kz/iz — at). From this form, the inverse z transform 
/(«) is obtained as Ylk^\ Rk{akTu{n). 

However, there is an alternative method, to expand a transfer function expressed 
in the form, when it has only simple poles 



riwd-iK"') 

to its partial fraction form 



^(1-au 1) 



where 

Rk= H{z-'){l-akZ-%^^^ 

Then the inverse z transform is the sum of the inverse z transform of all the terms 
in (2.39): h{n) = Xlfc=i Rk{akTu{n). We prefer the first method because we are 
already familiar with the partial fraction expansion of H{s) and know how to 
find the residues when it has multiple poles in the s plane. This method will be 
illustrated by several examples that are worked out in the following pages. 



2.2.2 Zero Input and Zero State Response 

In Section 2.2.1, the total output y{n) was obtained as the sum of two outputs 
yQiin) = (0.5)«M(n) and >'o,(n) = 16.666[(0.5)" - (0.2)"]M(n). 

If the input function x{n) is zero, then X{z) = 0, and Y{s) in (2.34) will 
contain only the term Fo, (z) = Q.5y{—l)z/iz — 0.5) = z/(z — 0.5); therefore the 
response y{n) = (0.5)" m(«) when the input is zero. The response of a system 
described by a linear difference equation, when the input to the system is assumed 
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to be zero is called the zero input response and is determined only by the initial 
conditions given. The initial conditions specified with the difference equation are 
better known as initial states. (But the term state has a specific definition in the 
theory of linear discrete-time systems, and the terminology of initial states is con- 
sistent with this definition.) When the initial state y{—\) in the problem presented 
above is assumed to be zero, the z transform of the total response F(z) contains 
only the term Fo,(z) = 5/(z - 0.5)Z(z) = 5/[(z - 0.5)(z - 0.2)], which gives a 
response yosin) = 16.666[(0.5)" — (0.2)"]M(n). This is the response y{n) when 
the initial condition or the initial state is zero and hence is called the zero state 
response. The zero state response is the response due to input only, and the zero 
input response is due to the initial states (initial conditions) only. We repeat it 
in order to avoid the common confusion that occurs among students! The zero 
input response is computed by neglecting the input function and computing the 
response due to initial states only, and the zero state response is computed by 
neglecting the initial states (if they are given) and computing the response due to 
input function only. Students are advised to know the exact definition and mean- 
ing of the zero input response and zero state response, without any confusion 
between these two terms. 

2.2.3 Linearity of the System 

If the input x{n) to the discrete-time system described by (2.33) is multipHed 
by a constant, say, K = 10, the total response of the system y{n) is given as 
yoi{n) + lO)'oj(n), which is not 10 times the total response yoiin) + yo.s(n)- This 
may give rise to the incorrect inference that the system described by the difference 
equation (2.33) above, is not linear. The correct way to test whether a system 
is linear is to apply the test on the zero state response only or to the zero input 
response only as explained below. 

Let the zero state response of a system defined by a difference equation be 
yi{n) when the input to the system is xi{n) and the zero state response be yjin) 
when the input is X2{n), where the inputs are arbitrary. Here we emphasize that 
the definition should be applied to the zero state response only or to the zero input 
only. So the definition of a linear system given in Section 2.1 is repeated below, 
emphasizing that the definition should be applied to the zero input response or 
zero state response only. 

Given a system a;(«) ^ y(n), if Kx{n) =>■ Ky{n) and K\x\{n) + K2X2{n) => 
Kiyi{n) + K2y2(n), then the system is Unear, provided y(n) is the zero state 
response due to an input signal x{n) or the zero input response due to initial 
states. Now it should be easy to verify that the system described by (2.33) is a 
linear system. 

2.2.4 Time-Invariant System 

Let a discrete-time system be defined by a hnear difference equation of the 
general form (2.3), which defines the input-output relationship of the system. 
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Let us denote the solution to this equation as the output y{n) when an input x(n) 
is applied. Such a system is said to be time-invariant if the output is yin — N) 
when the input is x(n — N), which means that if the input sequence is delayed 
by samples, the output also is delayed by samples. For this reason, a time- 
invariant discrete-time system is also called a shift-invariant system. Again from 
the preceding discussion about linearity of a system, it should be obvious the 
output y{n) and y(n — N) must be chosen as the zero state response only or 
the zero input response only, when the abovementioned test for a system to be 
time-invariant is applied. 



2.3 USING z TRANSFORM TO SOLVE DIFFERENCE EQUATIONS 

We will consider a few more examples to show how to solve a linear shift- 
invariant difference equation, using the z transform in this section, and later we 
show how to solve a single-input, single-output difference equation using the 
classical method. Students should be familiar with the procedure for decompos- 
ing a proper, rational function of a complex variable in its partial fraction form, 
when the function has simple poles, multiple poles, and pairs of complex conju- 
gate poles. A "rational" function in a complex variable is the ratio between two 
polynomials with real coefficients, and a "proper" function is one in which the 
degree of the numerator polynomial is less than that of the denominator polyno- 
mial. It can be shown that the degree of the numerator in the transfer function 
H(s) of a continuous-time system is at most equal to that of its denominator. In 
contrast, it is relevant to point out that the transfer function of a discrete-time 
system when expressed in terms of the variable need not be a proper func- 
tion. For example, let us consider the following example of an improper function 
of the complex variable z~^: 

= (2.40, 

z ^ — z ^ + 2.0 

In this equation, the coefficients of the two polynomials are arranged in descend- 
ing powers of z~^, and when we carry out a long division of the numerator by 
the denominator, until the remainder is a polynomial of a degree lower than that 
in the denominator, we get the quotient (z~^ + 0.2z~^ — 4.0) and a remainder 
(-4.8Z-1 + 8.0): 

Hiz-') = z-^ + 0.2Z-1 - 4.0 + (2.41) 

z — z -1-2.0 

= z-2 + 0.2z-i -4.0 + ifi(z-') (2.42) 

Since the inverse z transform of z"" is S{n — m), we get the inverse z trans- 
form of the first three terms as S{n — 2) + 0.25 (n — 1) — 4.05 (n), and we add it 
to the inverse z transform of the Hi(z~^), which will be derived below. 
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Example 2.9: Complex Conjugate Poles 

Let us choose the second term on the right side of (2.41) as an example of a 
transfer function with complex poles: 

-4.8.- + 8.0 



z-2 - z-1 + 2.0 

Multiplying the numerator and denominator by z^, and factorizing the denomina- 
tor, we find that Hi iz~^) has a complex conjugate pair of poles at 0.25 ± 70.6614: 

_ Hz'-0.6z) 
8(z2 - 0.6z) 



= 4 



2(z2 - 0.5z + 0.5) 

(z^ - 0.6z) 



(z - 0.25 - 70.6614)(z - 0.25 + 7O66I4) 

Let us expand Hi (z) /z into its modified partial fraction form: 

Hi(z) _ 2 + J 1.0583 2 -J 1.0583 

z ~ z - 0.25 - jO.6614 z - 0.25 + 70.6614' 

It is preferable to express the residues and the poles in their exponential form 
and then multiply by z to get 

_ (2.2627e>0-^^^^) z (2.2627g-^»-^^6^) z 
"^^^^ ~ z - 0.7071e^i-209 + z - 0.7071e-^i-209 

The inverse z transform of Hi (z) is given by 

hi{n) = {(2.2627e^"-4867) (0.7071e'i-20'')« 

+ (2.2627e-'°-^**'^^) (0.707 le-'i'^o^)"} „(«) 

= { 2.2627 (0.707 1 )" e' ^ •2"'''' ^-^^^se? 

+ 2.2627(0.7071)"e-^''-2''^V-'"-^**'^^} u{n) 

= 2.2627(0.7071)" {e^(l-209«+0.4867) ^ ^-,(1.209„+0.4867)} 

= 2.2627(0.7071)" {2cos(1.209n + 0.4867)} u(n} 
= 4.5254(0.7071)" {cos(1.209n + 0.4867)} u{n). 

Adding these terms, we get the inverse z transform of 

(2.2627e^0-4867)2 (2.2627 e'^^-^^^'^) z 
/f(z-i) = z-2 + 0.2z-i-4.0+^ — ,,,no + 



z-0.7071e^i-209 z-0.7071e-^i 



209 
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hin) = Sin - 2) + 0.25(n - 1) - 4.0S(n) + 2.2627e-'°-'*^*^^(0.7071e-'''-2°V 
+ 2.2627e^-0-^^^^(0.7071e-^'-205rM(n) 
= S(n - 2) + 0.2S(n - 1) - 4.05(n) + 2.2627(0.7071)" 

X {^;(1.209„+0.4867) ^ g-;(1.209„+0.4867)j„(„) 

= 5(n - 2) + 0.25(n - 1) - 4.05(n) + 2.2627(0.7071)" 

X {2cos(1.209« + 0.4867)}M(n) 
= Sin - 2) + 0.25(n - 1) - 4.05(n) 

+ 4.5254(0.7071)" {cos(1.209n + 0.4867)} m(«) 

Note that the angles in this solution are expressed in radians. 
Example 2.10 

Let us consider a discrete-time system described by the linear shift-invariant 
difference equation of second order given below 

yin) = 0.3yin - 1) - O.Olyin -2) + xin) - O.lxin - 1) 

where 

xin) = (-0.2)"t<(«) 

y(-i) = 1.0 

yi-2) = 0.6 

Using the z transform for each term in this difference equation, we get 

Yiz) = 03[z-^Yiz) + yi-l)] - 0.02[z-^Yiz) + z~^yi-l) + yi-2)] 
+ Xiz) - 0.l[z-^X iz) + xi-1)] 

We know Xiz) = z/iz + 0.2) and Jc(— 1) = 0. Substituting these and the given 
initial states, we get 

y(z)[l - 0.3Z-1 + 0.02Z-2] = [0.3y(-l) - 0.02z-V(-l) - 0.02>;(-2)] 

+ Z(z)[l -O.lz-M 

= [0-3y(-l) - 0-02z-'y(-l) - 0.023;(-2)] 
[1 -0.3Z-1 +0.02Z-2] 

X(z)[l-0.1z-'] 
[1 - O.Bz-i + 0.02Z-2] 
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When the input x(n) is zero, X{z) = 0; hence the second term on the right side 
is zero, leaving only the first term due to initial conditions given. It is the z 

transform of the zero input response yoi(n). 

The inverse z transform of this first term on the right side 

^ [03y{-l) - 0.02z-'y(-l) - 0.023;(-2)] 
"'^^'^ [1 - 0.3Z-1 + 0.02Z-2] 

gives the response when the input is zero, and so it is the zero input response 
yoiin). The inverse z transform of 

X{z)[l-0.1z-'] ^ . , 



[1 - 0.3Z-1 + 0.02Z-2] 

gives the response when the initial conditions (also called the initial states) are 

zero, and hence it is the zero state response y^sin). 

Substituting the values of the initial states and for X{z), we obtain 

[0.288 - 0.02Z-1] _ [0.288z2 - o.02z] _ z[0.288z - 0.02] 
~ [1 - 0.3Z-1 + 0.02Z-2] " z2 - 0.3z + 0.02 ~ (z - 0.1)(z - 0.2) 

and 

x(z)[i -o.iz-'i r z 1 II -o.iz- ■ 



1 1 - 0.3Z-1 + 0.02Z-2] 



z + 0.2 



[1 - 0.3Z-1 + 0.02Z-2] 



z[z2-0.1z] z2(z- 0.1) 



(z + 0.2)(z2 - 0.3z + 0.02) (z + 0.2)(z - 0.1)(z - 0.2) 

We notice that there is a pole and a zero at z = 0.1 in the second term on the 
right, which cancel each other, and Y<is{z) reduces to z^/[(z + 0.2) (z — 0.2)]. We 
divide loi {z) by z, expand it into its normal partial fraction form 

Fo/(z) [0.288Z-0.02] 0.376 0.088 



z (z-0.1)(z-0.2) (z-0.2) (z-0.1) 
and multiply by z to get 

0.376Z 0.088Z 



%(z) = 



(z-0.2) (z-0.1) 



Similarly, we expand Yq,{z)Iz = z/[(z + 0.2)(z - 0.2)] in the form -0.5/(z + 
0.2) + 0.5/(z - 0.2) and get 

V < ^ z' -0-5z ^ 0.5z 

^Os(z) = , , ^ = , , + 



(z + 0.2)(z -0.2) (z + 0.2) (z-0.2) 

Therefore, the zero input response is yoK") = [0.376(0.2)" - 0.088(0.1)"]m(«) 
and the zero state response is )'os(") = 0.5[— (— 0.2)" + (0.2)"]M(n). 
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Example 2. 1 1: Multiple Poles 



Here we discuss the case of a function that has multiple poles and expand it into 
its partial fraction form. Let 



G(z) 



N(z) 



Z (Z - ZoYiz - Zl)(z - Z2)iz - Z3) • • • (Z - Zm) 

Its normal partial fraction is in the form 

G{z) Co , Ci 



iz - zoY ^ iz - zoY-^ 

ki k2 



+ ••• + 



Cr-l 

iz - zo) 



+ 



iz - zi) (z - Zl) 



+ ■■■ + 



iz - Zm) 



The residues ki,k2, ■ ■ ■ ,km for the simple poles at zi,Z2, ■ ■ . are obtained by 

the normal method of multiplying G(z)/z by (z — z,), i = 1,2,3, ... ,m and 
evaluating the product at z = Zi ■ The residue Q is also found by the same 
method: 



Co = (z - zo)' 



Gjz) 1 1 



iz=zo 



The coefficient Ci is found from 



d 
Tz 



iz - zo) 



,C(z)] 



z=zo 



and the coefficient C2 is found from 

1 

2dz^ 



iz - zo)' 



G(z) 



The general formula for finding the coefficients C^, 7 = 1, 2, 3, 



Cj = 



1 dJ 
J\'dU 



iz - zo)' 



(r — 1) is 
(2.43) 



z=zo 



After obtaining the residues and the coefficients, we multiply the expansion by z: 



Giz) = 



Coz 



+ 



Ciz 



iz - zo)'" iz - zo)'-i 
k\z k2Z 



+ ••• + 



+ 



(Z - Zl) ^ iz- Z2) 



+ ... + 



Cr-lZ 

iz - zo) 

kmZ 
iz - Zm) 



Then we find the inverse z transform of each term to get gin), using the z 
transform pairs given in Table 2.1. To illustrate this method, we consider the 
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function G(z), which has a simple pole at z = 1 and a triple pole at z = 2: 

z(2z2- iiz + 12) 



Giz) 
G(z) 



k = 
Co = 
Ci 

C2 



iz - l)(z - 2)3 
(2z^ - llz+ 12) 
(z- l)(z-2)3 

(2z2- 1U + 12) 



(2.44) 



Co 



+ 



C, 



C2 



(z - 2)3 
(2z2-llz + 12) 



(z-2)3 (z-2)2 (z-2) (z-1) 
= -3 



= -2 



/ (2z2- llz+ 12) 
rfz V (z - 1) 
1_J2^ / (2z2 - llz + 12) 
2Jz2 I, (z- 1) 



z=2 



2z^ - 4z - 1 



lz=2 



1 f 2z2 - 4z - 1 

2 I (z - 1)2 



= -1 



= 3 



Therefore we have 

Giz) = 



-2z 



+ 



+ 



3z 



+ 



-3z 



(2.45) 



(z-2)3 (z-2)2 (z-2) (z-1) 

Now note that the inverse z transform of az/{z — a)^ is easily obtained from 

Table 2.1, as na"u{n). We now have to reduce the term —z/{z — 2)^ to — (j)2z/ 
(z — 2)2 so that its inverse z transform is correctly written as —{^)n2"'u{n). From 
the transform pair 6 in Table 2.1, we get the inverse z transform of z/(z — a)3 
as n{n - l)/2\a"-^u(n). 

Therefore the inverse z transform of — 2z/(z — 2)3 is obtained as 

-2nin - 1) (2)«-2„(„) ^ ""^^ " (2)".(n) 



2! 4 
Finally, we get the inverse z transform of G(z) as 

-n(n- 1) ^^^„ _ n^2^„ _ ^^^^^ _ ^ 



M(n) 



2.3.1 More Applications of z Transform 

In this section, we consider the circuit shown in Figure 2.5 and model it by 
equations in the z domain, instead of the equivalent model given by equations 
(2.1) in the time domain. This example is chosen to illustrate the analysis of a 
discrete-time system that has a large number of adders and hence gives rise to 
a large number of difference equations in the z domain. Writing the z transform 
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z-^yi(z) 



Figure 2.5 A discrete-time system. 



for each of the equations in (2.1), we get 

Yiiz) = 0.3[z-'Yiiz) + yiC-l)] - 0.2[z-2yi(z) + z-Vi(-l) + >'i(-2)] 
-O.lz-iZ(z) 

1^2(2) = Yiiz) + 0.5[z-'Yi(z) + yi(-l)] - 0A[z-'Y2(z) + yii-l}] 

Y3(z) = Y2iz} + 0.6[z-'Y2(z) + yii-l)] + 0.871 (z) (2.46) 

Note that these are linear algebraic equations — three equations in three unknown 
functions Fi(z), l2(z), and Yj,{z), where the initial states and X{z) are known. 
After rearranging these equations as follows 

yi(z)[l - 0.3z-^ + 0.2Z-2] = 0.3yi(-l) - 0.2z-Vi(-l) 

+ yi(-2)-0.1z-'Z(z) 
7i(z)[-l - 0.5z-^] + Y2iz)[l + 0.4z-^] = 0.5yi(-l) - 0.43;2(-l) 
0.87i(z) + Y2{z)[l + 0.6z-'] - Y^iz) = -0.6y2i-l) 
we express them in a matrix form as 



(2.47) 



(1 - 0.3z-^ + 0.2Z-2) 0 0 
(-1-0.5Z-1) (1 + 0.4Z-2) 0 

0.8 (1 + 0.6Z-1) -1 



Yiiz) 
Yiiz) 
Y3(z) 



0.3yi(-l) - O.lz'hii-i) + yi(-2) - OAz-^X{z) 

0.5yi{-l)-0Ay2i-l) 

-0.6y2i-l) 



(2.48) 
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By use of matrix algebra, we can now find any one or all three unknown functions 
Yiiz), Y2iz), and Y^(z), when the input X{z) is zero — their inverse z transforms 
yield zero input responses. We can find them when all the initial states are 
zero — their inverse z transform will yield zero state responses. Of course we 
can find the total responses yiin), yiin), and ysin), under the given initial states 
and the input function x(n). This outlines a powerful algebraic method for the 
analysis of discrete-time systems described by any large number of equations in 
either the discrete-time domain or the z-transform domain. We use this method 
to find the zero input response and the zero state response and their sum, which 
is the total response denoted as yiin), yiin), and jaCn). 

2.3.2 Natural Response and Forced Response 

It is to be pointed out that the total response can also be expressed as the sum 
of the natural response and forced response of the system. First let us make 
it clear that the natural response is not the same as the zero input response 
of the system. The natural response is defined as the component of the total 
response, which consists of all terms displaying the natural frequencies of the 
system. Natural frequencies are also known as the "characteristic roots" of the 
system, eigenvalues of the system determinant, and poles of the transfer 
function. 

A few methods are used to find the natural frequencies of a system. Suppose 
that the system is described by its single input-output relationship as aoy{n) + 

a\y{n - 1) + a2y{n — 2)-\ h aNy{n - N) = boxin) + b\x{n - 1) H h 

buxin — M). 

If we assume the solution to the homogeneous equation to be of the form 
ydn) = A(c)", and substitute it as well as its delayed sequences, we get the 
following characteristic equation: 

A(c)"[ao + ai(c)-i -|- 02(0)-^ + • • • + aN{c)~^] 

= A{cT-^ [aoicf +ax{cf~^ + ---+ a^v-i (c) + un] = 0. 

Let the A'^ roots of the characteristic polynomial 

[ao(c)^ + aiic)^^^ -\ h aN-i(c) + a^] 

be denoted by (cj), fe), . . . , (cn), which are the natural frequencies. Assuming 
that all the roots are distinct and separate, the natural response assumes the form 

ydn) = AiiciT + A2(C2)" + • • • + A^icN)" 

which in classical literature is known as the complementary function or comple- 
mentary solution. 
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If, however, the characteristic polynomial has a repeated root (cr) with a mul- 
tiphcity of R, then the R terms in ydn) corresponding to this natural frequency 
(cr) are assumed to be of the form 

[Bo + Bin + B2n^ + ■■■ + B^n^](c,)« 

Suppose that the system is described by a set of linear difference equations such 
as (2.47). When we solve for Yi(z), l2(z), or ^3(2), we get the determinant of 
the system matrix shown in (2.48) as the denominator in Yi (z), ¥2(1), and Y^iz). 
The roots of this system determinant are the poles of the z transform Yi(z), 
Yiiz), Y^iz) and appear in the partial fraction expansion for these functions. The 
inverse z transform of each term in the partial fraction expansion will exhibit 
the corresponding natural frequency. All terms containing the natural frequencies 
make up the natural response of the system. The important observation to be made 
is that terms with these natural frequencies appear in the zero input response as 
well as the zero state response; hence the amplitudes Aj of the term with the 
natural frequency (cj ) have to be computed as the sum of terms with the natural 
frequency (cj) found in both the zero input and zero state response. It follows, 
therefore, that the natural response is not the same as the zero input response 
and the forced response is not the same as the zero state response. Computation 
of these different components in the total response must be carried out by using 
the correct definition of these terms. 



2.4 SOLVING DIFFERENCE EQUATIONS USING 
THE CLASSICAL METHOD 

Now that we have described the method for finding the complementary func- 
tion for a system described by an nth hnear ordinary difference equation, we 
discuss the computation of the particular function or particular solution, due to 
the specified input function. Note that this classical method can be used when 
there is only one such equation, and it is not very easy when there are many 
equations describing the given discrete-time system. Also, when the order of the 
characteristic polynomial or the system determinant is more than 3, finding the 
zeros of the characteristic polynomial or the system determinant analytically is 
not possible. We have to use numerical techniques to find these zeros, which are 
the natural frequencies of the system. If and when we have found the natural 
frequencies, the natural response can be identified as the function ydn) given in 
the preceding section. Next we have to choose the form of the particular function 
that depends on the form of the input or the forcing function. Hence it is the 
forced response, and the sum of the natural response (complementary function) 
and the forced response (particular function) is the total response. The form of 
the particular function is chosen as listed in Table 2.2. 

We substitute the particular function in the nonhomogeneous difference 
equation, and by comparing the coefficients on both sides of the resulting 
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TABLE 2.2 Form of Input Function and Forced Response 



Input or Forcing Function 



Particular Function or Forced Response 



2 



3 



A(a)«,a / ci(i = 1,2, ...) 
A{a)",a = Ci 
A cos(&)on + 0) 



B(a)" 

[Bo + Bin] (a)" 
B cos(wo« + <P) 



4 



equation, we compute the coefficient B or the coefficients 5, . Next we apply 
the given initial conditions on the sum of the complementary function and the 
particular function, in which there are n unknown constants of the complemen- 
tary function. When we obtain these constants that satisfy the initial conditions, 
and substitute them, the solution for the total output is complete. Example 2.12 
illustrates the classical method of solving a difference equation. 

Example 2.12 

Solve the linear difference equation given below, using the classical method: 



The characteristic polynomial is — 0.5z + 0.06 = (z — 0.3)(z — 0.2), which 
has the characteristic roots at zi = 0.3 and zi = 0.2. Since these are simple 
zeros, the complementary function ydn) = Ai(0.3)" -|- A2(0.2)". Since the input 
x(n) is given as 2(0.1)", we choose from Table 2.2, the particular function yp to 
be of the form yp(n) = B(O.l)". Thus we substitute yp{n - 1) = B(0.1)"-'and 
ypin - 2) = B(0.1)"'^ and get the following: 

5(0.1)" - 0.55(0.1)""' + 0.065(0.1)""2 ^ 2(0.1)" 
5(0.1)" - 0.5(10)5(0.1)" + 0.06(100)5(0.1)" = 2(0.1)" 
[1.0-5-F6]5(0.1)" = 2(0.1)" 

Therefore 6 = 1 and the particular function ypin) = (0.1)". So the total solu- 
tion is 

yin) = ydn) + ypin) 

= Ai(0.3)" + A2(0.2)« + (0.1)" 

When we apply the initial conditions on this total response, we get 



yin) - O.Syin - I) + 0.06yin - 2) = 2(0.1)" 

^(-l) = 1 and 



yi-2) = 0 



(2.50) 



(2.49) 



yi-1) = 3.3333Ai 5A2 -MO = 1 



yi-2) = ll.UlAi + 25A2 -MOO = 0 
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Solving these two equations, we get Ai = 9.903 and A2 = —8.4. So the total 
response is 

yin) = 9.903(0.3)" - 8.4(0.2)" + (0.1)" 

Example 2.13 

Let us reconsider Example 2.10. The zero input response and the zero state 
response in this example were found to be 

yoi(n) = [0.376(0.2)" - 0.088(0. l)"]M(n) 

yo,(n) = 0.5[-(-0.2)" + (0.2)"]M(n) = [0.5(0.2)" - 0.5(-0.2)"]M(n) 

The characteristic polynomial for the system given in Example 2.10 is easily 
seen as [1 — 0.3z~' + 0.02z~-^]. After multiplying it by z^, we find the natu- 
ral frequencies as the zeros of [z^ - 0.3z + 0.02] = [(z - 0.2) (z - 0.1)] to be 
(ci) = (0.2) and (02) = (0.1). Note that the zero input response yoi(n) has a 
term 0.376(0.2)" a (n), which has the natural frequency equal to (0.2) and the 
term —0.088(0. !)"«(«) with the natural frequency of (0.1), while the zero state 
response yos(n) also contains the term 0.5(0.2)"M(n) with the natural frequency 
of (0.2). We also noticed that the pole of Yosiz) at z = 0.1 was canceled by a zero 
at z = 0.1. Therefore there is no term in the zero state response yos(n) with the 
natural frequency of (0.1). So the term containing the natural frequency of (0.2) is 
the sum 0.5(0.2)"M(n) + 0.376(0.2)«M(n) = 0.876(0.2)"M(n), whereas the other 
term with the natural frequency of (0.1) is — 0.088(0.1)"m(h). Consequently, the 
natural response of the system is 0.876(0.2)"M(n) - 0.088(0. l)"a(n). 

The remaining term — 0.5(— 0.2)"M(n) is the forced response with the fre- 
quency (—0.2), which is found in the forcing function or the input function 
x(n) = (—0.2)"u(n). Thus the total response of the system is now expressed as 
the sum of its natural response 0.876(0.2)" M(n) — 0.088(0.1)"M(n) and forced 
response — 0.5(— 0.2)"M(n). We repeat that in the zero state response, there are 
terms with natural frequencies of the system, besides terms with input frequen- 
cies; hence it is erroneous to state that the zero input response is equal to the 
natural response or that the zero state response is the forced response. 

Example 2. 14 

As another example, let us analyze the discrete-time system model shown in 
Figure 2.6. Assuming the initial states are zero, we get the equations for the 
outputs of the two adders as 

yi(n) = x{n - 1) - 0.2yi(n - 1) - 0.4^1 (n - 2) 

);2(n) = 2>'i(n- 1)-0.1);2(«- 1) 

When a discrete-time system is described by several linear difference equations 
like the equations above, it is difficult to derive a single-input, single-output 
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Figure 2.6 Example of a discrete-time system. 



equation, and hence solving for output by using the recursive algorithm or 
the classical method is not possible. However, we can transform the difference 
equations to their equivalent z-transform equations. They become linear, alge- 
braic equations that can be solved to find the z transform of the output using 
matrix algebra. The inverse z transform of the output function gives us the final 
solution in the time domain. So it is the z-transform method that is the more pow- 
erful method for time-domain analysis. To illustrate this method, let us transform 
the two equations above in the time domain to get the following: 

yi(z) = z~'X(z) -0.2z"'Fi(z) -0.4z~^Fi(z) 
F2(z) = 2z-'Fi(z)-0.1z-'y2(z) 
Rearranging these equations in the form 

Fi(z)[l + 0.2z~' + 0.4z"^] + F2(z)[0] 
}'i(z)[-2z-'] + F2fe)[l+0.1z-'] 

and expressing them in a matrix equation as 



(1 + 0.2Z-1 + 0.4Z-2) 


0 




'Yiiz)' 




' z-'X(z)' 


-2z-' 


(l + 0.1z-')_ 




. ^2(z) . 




0 



from Cramer's rule, we find the z transform of the output y2{n): 

(1 0.2z-i + 0.4z-2) z-^Z(z) 

-2z-i 0 

Yiiz) = ; 5 

(1 + 0.2z-> +0.4Z-2) 0 

-2z-' (1 + O.lz-i) 



^z-'X{z) 
= 0 
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2zr^ ■ 

1 + 0.3z-i + 0.42Z-2 + 0.04Z-3 
2z 



+ 0.3z2 + o.42z + 0.04 



X{z) 



When we substitute the z transform of the given input above and iind the inverse 
z transform, we get the output y2{n). 

In this example, the natural frequencies of the system are computed as the 
zeros of the system determinant 



(1 + 0.2Z-1 + 0.4z-2) 0 



-2z- 



which is 1 + 0.21Z-1 + 0.42Z-2 _,_ o.o4z- 



(1+O.lz-^) 



z-'lz" + 03z^ + 0.42z + 0.041. It 
is obvious that the zeros of this determinant are the same as the poles of the 
transfer function 



H{z) = 



Yiiz) 
Xiz) 



2z 



z^ + 0.3z2 + 0.42z + 0.04 



As long as these poles of H(z) are not canceled by its zeros, that is, if there 
are no common factors between its numerator and the denominator, its inverse z 
transform will display all three natural frequencies. If some poles of the transfer 
function are canceled by its zeros, and it is therefore given in its reduced form, we 
may not be able to identify all the natural frequencies of the system. Therefore 
the only way to find all the natural frequencies of the system is to look for 
the zeros of the system determinant or the characteristic polynomial. We see 
that in this example, the system response does contain three terms in its natural 
response, corresponding to the three natural frequencies of the system. But if 
and when there is a cancellation of its poles by some zeros, the natural response 
components corresponding to the canceled poles will not be present in the zero 
state response hin). So we repeat that in some cases, the poles of the transfer 
function may not display all the natural frequencies of the system. 

Note that the inverse z transform of Y2(z) is computed from F2(z) = H(z)X(z) 
when the initial states are zero. Therefore the response y2{n) is just the zero state 
response of the system, for the given input x{n). 



2.4.1 Transient Response and Steady-State Response 

The total response can also be expressed as the sum of its transient response and 
steady-state response. But there is again a misconception that the natural response 
of a system is the same as the transient response, and hence an explanation is 
given below to clarify this misconception. 

The transient response is the component of the total response, which approaches 
zero as n -> oo, whereas the steady-state response is the part that is left as the 
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nonzero component. All terms with their frequencies that lie within the unit circle 
of the z plane approach zero as n -> oo, and terms with simple poles that lie on 
the unit circle contribute to the steady- state response. 
For example, let us consider a function 

- z 0.4z 0.5e^'^"°z 0.5e--^'^"°z 

~ ^ ^ {z - 0.2)2 + (2 + 0.4) ^ (z - e^-50°) ^ (z - e-^-50°) 

The response y{n) is obtained as 

y{n) = [0.5 5n(0.2)" + 0.4(-0.4)" + cos(50°n 40°)] u(n) 

In this example, Y(z) has a double pole at z = 0.2 and a simple pole at z = —0.4, 
and the terms [5«(0.2)" -|- 0.4(— 0.4)"] «(«) corresponding to these frequencies 
inside the unit circle constitute the transient response in y(n) since these terms 
approach zero as n -> oo. The other terms in F(z) have a pole at z = 1 and 
another one at z = ±e-'^^ . These are frequencies that lie on the unit circle, 
and their inverse z transform is [0.5 + cos(50°n + 40°)] M(n), which remains 
bounded and is nonzero as n -> oo. It is the steady-state component in y{n), and 
obviously the sum of the transient response and steady-state response is the total 
response y(n) of the system. The frequencies at z = ±e'^^ may be the natural 
frequencies of the system or may be the frequencies of the forcing function; this 
also applies for the other frequencies that show up as the poles of Y{z). The 
natural response and forced response are therefore not necessarily the same as 
the transient response and the steady-state response. Only by using the different 
definitions of these terms should one determine the different components that add 
up to the total response. In summary, we have shown how to express the total 
response as the sum of two terms in the following three different ways: 

• The zero state response and the zero input response 

• The natural response and the forced response 

• The transient response and the steady-state response 



2.5 z TRANSFORM METHOD REVISITED 

The transfer function H{z) of a system is defined as the ratio of the z transform 
of the output and the z transform of the input, under the condition that all initial 
states are zero and there are no other independent sources within the system. For 
the system described in Figure 2.6, the ratio 

X(z) z^ + 03z^ + 0.02z + 0.S 



is the transfer function. So we can also use the relationship FiCz) = H{z)X(z). 
That means that when Z(z) = 1 and when the initial states are zero, we have 
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Y2iz) = H(z), or the output response of a system when it is excited by a unit 
pulse function S{n), under zero initial states, is given by the inverse z transform 
of H{z). Thus the unit pulse response denoted by h(n) is given by Z^^\H{z)]. 
So h{n) is the response of the system due to an excitation S(n) only. However, 
from the general relationship FiCz) = H(z)X{z), we observe that if we know the 
transfer function H(z) or if we know the unit pulse response h{n) of the system, 
we can find the response due to any other input x{n). Therefore H{z) or the 
unit impulse response h{n) constitutes another model for the system. If we have 
derived or have been given H(z) or h{n), next we find the z transform X(z) 
of the given input, and multiply H(z) and X{z) to get Y{z) = H{z)X{z) as the 
z transform of the output. Then we find the inverse z transform of Y(z) to get 
the output y(n). For these operations, which are algebraic in nature, finding the 
output y{n) as the inverse z transform of H{z)X{z) is an efficient method for 
finding the system output. It is this z-transform method that is used extensively 
in system analysis, but it depends on the satisfaction of two conditions: (1) we 
can find the z transform of the input sequence and (2) we know or can find the 
transfer function of the system under investigation. Students should be aware that 
in practice, either one or both of these conditions may not be satisfied and other 
methods of analysis or design of systems are called for. For example, finding a 
closed-form expression for a discrete-time signal obtained by sampling a speech 
is not easy. Finding the transfer function of physical systems may not be as easy 
and straightforward as the one shown in (2.46). In this book, we assume that 
these conditions are always satisfied. 

2.6 CONVOLUTION REVISITED 

In a previous section on convolution, we had shown that the output y(n) of a 
linear, shift-invariant, discrete-time system is obtained by convolution of x(n) 
and h{n), specifically, y{n) = x{n) * h(n) = X!^o-^ ~ 

Since Y{z) = H{z)X(z) = X{z)H{z), we now conclude that convolution sum 
operation is commutative: 

x(n) * h{n) = h(n) * x(n) 

Therefore yin) = Y.V=ox{k)h{n -k) = J2T=ohik)x(n - k). 
Another way of proving this result is as follows. Let 

CX) 

y(n) = ^^^x{k)h{n — k). 
k=0 

Then 



OO OO 

Y{z) = J2y(n^^~" = J2 



OO 

^x(fe)ft(n — k) 
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Interchanging the order of summation, we obtain 

oo oo 

F(z) = ^x(^)^/i(n-/:)z-« 

«=0 

Let us make a substitution m = n — k, and now we have 

oo oo 

fc=0 m=—k 

oo oo 

k=0 m=—k 

But him) = 0 for — A: < OT < — 1, so that 

00 00 

k=0 m=0 

= Xiz)Hiz} = H{z)X{z) 

So we have proved that 

1. x{n) * hin) = h{n) * x(n), which means that the convolution sum is com- 
mutative. It is now easy to prove that this satisfies the following additional 
properties, by using the algebraic relationships for the z transforms of the 
discrete-time sequences. 

2. KXi(z)X2iz) = Xi{z)KX2iz)- Hence convolution sum operation is linear : 
Kxi{n) * X2in) = xi{n) * Kx2{n). 

3. {Xi{z)X2{z)]X-i{z) = X'i(z)[Z2(z)^3(z)]. Hence convolution sum opera- 
tion is associative: 

[xi(n) * X2(n)] * x^in) = xi(«) * [x2in) * X3(n)] 

4. Xiiz)[X2{z) + X3iz)] = Xiiz)X2iz)+Xiiz)X3(z). Convolution sum opera- 
tion is distributive: 

xi(n) * [x2(n) + x^in)] = xi(n) * X2in) + xi(n) * X3(«) 

It is interesting to make a new interpretation of the convolution sum operation 
as explained below. Let the z transforms X{z), H{z), and Y{z) be expressed in 
their power series expansion: 

X(z) =Xo+ XiZ~^ + X2Z~^ + X3Z~^ H 

H(z} = ho + hiz~^ + h2Z~^ + h3Z~^ + ■■■ 

Yiz) = yo + yiz'^ + yiz-^ + ysz'^ + y^z'* + ysz'^ + y^z'^ + ■■■ 
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The coefficients xq, xi,X2, . . ■ and ho, hi, h2, h^, . . . are the known samples of 
the input xin) and the unit sample response hin). Either one or both sequences 
may be finite or infinite in length. If we multiply the polynomial or the power 
series for X(z) and H(z), and group all the terms for the coefficients of z~", in 
the polynomial or the power series, we get 

X{z)H(z) = (Xo + XiZ~^ + X2Z~^ + X3Z~^ + • • •) 

X {ho + hiz"^ + h2Z~^ + h3Z~^ + • • •) 

= (xoho) + (xq/ii + xiho)z~^ + (xoh2 + xih\ + X2ho)z~^ 

+ {xohj, + x\h2 + X2h\ + xj,ho)z~^ H 

By comparing the coefficients of z"" in Y{z) and those in this expression, we 
notice that 

yo = (xoho) 

yi = (xohi + xiho) 

y2 = {xoh2 + Xlhl+ X2ho) 

y3 = (xohj + xih2 + X2hi + x^ho) 

(2.51) 

yn = (Xohn + Xih„-i + X2h„-2 + xshn-s H 1- x„ho) 



These are the same results as given in (2.7), which are obtained by expanding the 
convolution sum y„ — ^'^-^x{k)h{n — k). We can multiply the polynomial 
or the power series as H{z)X{z) and identify the coefficients of the resulting 
polynomial as >»„ = YlT=-oo h{k)x{n — k). [We can also find the coefficients of 
H(z)X{z) by computing the convolution of the coefficients of H(z) and X(z)-] 
Then we would get the following expressions for the coefficients, which are 
the same as those given in (2.51): 

yo = (hoxo) 

yi = (hoxi + hixo) 

y2 = (hoX2 + hlXl+ h2Xo) 

y3 = ihoX3 + hiX2 + h2Xi + h3Xo) 



(2.52) 
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yn = (hoXn + hiX„-\ + h2Xn-2 + h3Xn-3 H h hnXo) 



One can store the coefficients h{n) and x(n) for a system being investigated, 
on a personal computer or workstation, do the time reversal off line, delay the 
time-reversed sequence, and multiply the terms and add the products as explained 
in Figure 2.4. Computer software has been developed to perform the convolution 
of two sequences in a very rapid and efficient manner — even when the sequences 
are very long.^ But a real hardware that contains the electronic devices such as 
the delay element, multiplier, and the adder cannot reverse a sequence in real 
time, but it operates on the incoming samples of the input as follows. When the 
sample xq enters the system at f = 0, it launches the sequence XQh(nT), which 
appears at the output; when the next sample xi enters the system at t = T, it 
launches the sequence x\h{nT — T), which appears at the output, and when the 
next sample X2 enters the system, the sequence at the output is X2h(nT — 2T), 
and so on. At any time t = rtiT, the value of the output sample is 

y(mT) = xoh{mT) + xth(mT — T) + X2h(mT — 2T) + x^himT — 3T) H 

This is the physical process being implemented by the real hardware; an example 
of this process was described in Figure 2.2. However, a real hardware can be 
programmed to store the input data x(n) and h{n) in its memory registers and to 
implement the convolution sum. 

It is important to remember that convolution can be used to find the output, 
even when the input sequence does not have a z transform, that is, when we 
cannot use the z-transform approach. This makes convolution a very fundamen- 
tal operation for signal processing and is one of the most powerful algorithms 
implemented by the electronic hardware as it does not know what z transform is! 

Example 2. 15 

Suppose that the input sequence is x{n) = (0.1)"^M(n) and the unit impulse 
response ^(n) = {0.2 0.4 0.6 0.8 1.0}. 

The z transform X(z) for the infinite sequence x(n) does not have a closed- 
form expression, whereas it is easy to write the z transform H(z) = 0.2 -|- 
0.4z-i -I- 0.6z~^ + 0.8Z-3 -I- z""^. Therefore we cannot find Z(z)//(z) = Yiz) as 
a rational function and invert to get y(n). However, the polynomial H(z) can be 
multiplied by the power series Z(z) = X!^o(0-l)" 2" y(n), according 

^Two methods used to improve the efficiency of computation are known as the overlap-add and 
overlap-save methods. Students interested in knowing more details of these methods may refer to 
other books. 
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to either one of the algorithms x(n) * h(n) or h{n) * x(n). For example 
y(0) = 0.2 

);(1) = 0.4 + 0.1(0.2) 

y(2) = 0.6 + (0.1)(0.4) + (0.1)^0.2) 

y(3) = 0.8 + (0.1)(0.6) + (0.1)^0.4) + (0.1)^0.2) 



Recollect that we have obtained two different equations for finding the output 
due to a given input. They are the convolution sum (2.6) and the linear difference 
equation (2.2), which are repeated below. 

00 

y(n) = Y^x{k)h(n - k) (2.53) 

k=f) 

N M 

y{n) = - ^a{k)y{n - k) + b{k)x{n - k) (2.54) 
k=\ k=0 

In Equation (2.53), the product of the input sequence and the current and previ- 
ous values of the unit impulse response are added, whereas in Equation (2.54) 
the previous values of the output and present and past values of the input are 
multiplied by the fixed coefficients and added. The transfer function H{z) for 
the first case is given by H{z) = Xi^o h{n)z~", and for the second case, we use 
the z transform for both sides to get 



M 



^iz) = - ^a(fe)z-'=F(z) + Y,mz-'''X{z) 



/t=i 



1 +^a(^)z" 



M 



= J2b(k)z-'X{z) 



k^O 



Yiz) _ T,k^oHk)z 



Hiz) = 



So we can derive the transfer function H{z) from the linear difference equation 
(2.54), which defines the input-output relationship. 

We can also obtain the linear difference equation defining the input-output 
relationship, from the transfer function H{z), simply by reversing the steps as 
follows. Given the transfer function H{z), we get }'(z)[l + Xl*Li "^C^)^"*] = 
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J2k=ob(k)z~''X(z). Finding the inverse z transform for each term, we arrive at 
the input-output relationship for the system, as shown by the following example. 

Example 2.16 

Let us assume that we are given a transfer function 



0.8 + 0.6z + 0.2z2 + z3 



We rewrite it as a transfer function in inverse powers of z, by dividing both the 
numerator and denominator by to get 

_K 0.1z-2 + 0.2z-3 y(z-i) 



1 + 0.2Z-1 + 0.6z-2 + 0.8z-3 Z(z-i) 
Therefore 

7(z-i) [1 + 0.2Z-1 + 0.6Z-2 + o.Bz"^] = Xiz'^) [O.lz"^ + 0.2z-'] 

By expressing the inverse z transform of each term, we get the linear difference 
equation or the input-output relationship 

y(n) + 0.2y{n - 1) + 0.6yin - 2) + 0.8y{n - 3) = 0.1x(n - 2) + O.lxin - 3) 

Since the transfer function has been defined and derived by setting the initial 
conditions to zero , one may assert that from the transfer function we cannot 
find the response due to initial conditions, but this is not true. In the preceding 
example, after we have derived the input- output relationship from the given 
transfer function, we write the corresponding z-transform equation including the 
terms containing the initial conditions, in the form 

7(z) + 0.2[z-iy(z) + ^(-1)] + 0.6[z-2y(z) + z'^yi-l) + yi-2)] 

+ O.S[z-^Yiz) + z-^i-l) + z~V(-2) + y(-3)] 
= 0.1z-^Z(z) + 0.2z-^Z(z) 

We substitute the initial conditions y(—l), y(—2) and y{—3), in these equations 
and obtain the zero input response as well as the zero state response of the 
system. Therefore the transfer function H(z) constitutes a complete model of the 
discrete-time system. 



2.7 A MODEL FROM OTHER MODELS 



In this section, we review the important concepts and techniques that we have 
discussed so far. For this piupose, we select one more example below. 
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Example 2.17 

The circuit for a discrete-time system is shown in Figure 2.7. The equations that 
describe it are. 

yi(n) = -x{n) + y^in - 2) 

y2{n) = d2y\(n)+x{n - 1) - y^in - 1) (2.55) 
y^{n) = x{n - 2) + d\y2{n) 

Let us try to eliminate the internal variables yi{n) and y2{n) and get a difference 
equation relating the output yj,{n) and x(n): 

yi(n) = x{n - 2) + di [d2yi{n) + x(n - 1) - ysin - 1)] 

= x{n — 2) + di [d2 {—x{n) + y^in — 2)} + x(n — 1) — y^in — 1)] 

The difference equation given below is the input-output relationship obtained 
by substituting the expression for y2{n) and yi{n) successively in the expression 
for ysin): 

y^in) + diy^in — 1) — d\d2yi{n — 2) = x{n — 2) + d\x{n — 1) — d\d2x{n) 

(2.56) 

But remember that in general, it may not be so easy to obtain the single-input, 
single-output relationship from the many equations written in the time domain, 
by successive elimination. It is always easier to z-transform Equations (2.55) or 
write them directly from the circuit diagram, use matrix algebra to obtain the 
transfer function H{z) and then obtain the difference equation as shown below: 

Yiiz) = -X{z) + z~^Yi{z) 



x(n)- 





x(n-1) 


z-1 











x(n - 2) 



Vain) 




Figure 2.7 Structure of a discrete-time system. 



72 



TIME-DOMAIN ANALYSIS AND z TRANSFORM 



Yliz) = d2Y,iz) + z-'Xiz) - z-'Y^iz) (2.57) 

Y3iz)=Z-^Xiz)+diY2iz) 

Solving these algebraic equations, by using matrix algebra, we get 

^ = Hiz) = (2.58) 

Now we can derive the difference equation relating the input and output, in the 
form of (2.56). 

Let us choose di = 0.5 and d2 = —0.5. Then the preceding transfer function 
reduces to 

„^ ^ z-2 + 0.5Z-1 + 0.25 



I + 0.5z-i + 0.25Z-2 
1 + 0.5z + 0.25z2 



(2.59) 



z2 + 0.5z + 0.25 

The unit impulse response h{n) is computed as the inverse z transform of i/(z): 



(z + 0.25 - yO.433) (z + 0.25 + jO.433) 

_ 4 (1.9843e-'i^°-9°) {l.9Wie-}^^'^°) 
~~z^ (z-0.5e^i20°) ^ (z-0.5e-^i20°) 

Therefore we have 

(1.9843e^' 160-9° )z (1.9843e-^'i60-9°)z 
^ (z-0.5e^i20°) ^ (z - 0.5e-^i20°) 



/i(n) = 45 (n) + 1.9843 



\0.5e^'i20°)„^ ^-160.9° (0 5^-ii20°)«j 



= 45(n) + [3.9686(0.5)" cos(120°n + 160.9°)] u{n) (2.60) 
2.7.1 Review of Model Generation 

Using the example above, we review the different models derived for the system 
and show how we can obtain one model from the other models. Recollect the 
two definitions for a model of the discrete-time system given in Section 2.1: 

1. The circuit shown in Figure 2.7 is model 1, in a block diagram represen- 
tation. 

2. The equations in the discrete- time domain is model 2 — an example is 
Equation (2.55). 
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3. The single difference equation for the input-output relationship is model 
3 — an example is Equation (2.56). 

4. The equations in the z domain is model 4 — an example is Equation (2.57). 

5. The z transform for model 3 or the transfer function H{z) is model 5 — an 
example is Equation (2.59). 

6. The unit impulse response h{n) is model 6 — an example is Equation (2.60). 

The first model is a circuit diagram, whereas the remaining ones are mathematical 
models describing the discrete-time system. 

In the example worked out above, we have shown how to derive model 2 
from model 1, model 3 from model 2, to model 6 from model 5. It is easy to see 
that we can get model 5 from model 6 and model 3 from model 5. But when we 
get a model 2 or 4 from model 3 or 4, the result is not unique. We will show 
that getting a circuit model from model 5 is not unique, either. Yet the flexibility 
to generate one model from many of the other models makes the analysis of 
discrete-time systems very versatile and requires that we learn how to choose the 
most appropriate model to find the output of a system for a given input, with 
initial states also given. Even when the transfer function of a system is derived 
under zero initial states, we can get model 3 and then can include the previous 
values of the output as the initial states and obtain the total output. 

Property 2.3: Time Reversal If X (z) is the z transform of a causal sequence 
x{n), n > 0, then the z transform of the sequence x{—n) is X{z~^). The sequence 
.x(—n) is obtained by reversing the sequence of time, which can be done only by 
storing the samples of x{n) and generating the sequence x(—n) by reversing the 
order of the sequence. If a discrete-time sequence or data x(n) is recorded on an 
audiocassette or a magnetic tape, it has to be played in reverse to generate x(—n). 
The sequence x{—n) and its z transform X(z~^) are extensively used in the 
simulation and analysis of digital signal processing for the purpose of designing 
digital signal processors, although the sequence x(—n) cannot be generated in 
real time, by actual electronic signal processors. 

Let Z(z) = i:~ox(n)z-«. Then, EL-co = Er=o^(«)2" = 

X{z-'). 

Example 2.18 

^[(0.5)"M(n)] = y;(0.5)«z-" = ^ = = Xiz) 

1 — 0.5z~' z — 0.5 

n=0 

Then 

0 7-1 1 

^[(0.5)-«M(-n)] = V (0.5)-«z" = Xiz-') = ^ ^ . = , „^ 

z~^ — 0.5 1 — 0.5z 

n=— 00 

F()^ O.I+0.25z-i+0.6z-^ 

I.O + 0.4Z-1 + 0.5Z-2 + 0.3Z-3 + 0.08Z-4 ^ ' ' 
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is the z transform of f{n)u{n), multiplying both the numerator and denominator 
polynomial by z^, we can express F{z) in the form 

- 0-lz^ + 0-25z3 + 0.6z^ 

~ z^ + 0.4z3 + 0.5z2 + 0.3z + 0.08 ^ ' 

The z transform of f (—n)u{—n) is obtained by replacing z by z~^ in (2.62) for 
F(z), and therefore the z transform of f{—n)u{—n) is 

_i _ + 0-25z-^ + 0.6z-^ 

'* ~ z-4 + 0.4Z-3 + 0.5Z-2 + 0.3Z-1 + 0.08 ^ ' 



0.1 + 0.25z + 0.6z2 



1.0 + 0.4z + 0.5z2 + 0.3z3 + 0.08z4 
which is different from either (2.61) or (2.62) for F(z) given above. 



(2.64) 



Property 2.4: Initial Value If the z transform of a sequence x(n) is known as 
Z(z), the value of its sample jc(0) is called the initial value and is easily found 
from 



jt:(0) = lim Z(z) 

We prove this result by expressing Z(z) — x(0) + x(l)z^' + x{2)z^^ + ■ ■ ■ and 
noting that all terms except the first term x(0) go to zero as z ^ oo. If, how- 
ever, we are interested in finding a few samples x(0), x{l), x(2), . . . ,x(k) at the 
beginning, and not just the initial value Ji:(0), then we use long division to get a 
few samples of the quotient as illustrated below. 
Consider, for example, the transfer function 

0.1 + 0.21Z-1 - 0.134Z-2 - 0.0514z-^ + • • • 

1.0 + OAz-^ + 0.5z-2)0.1 -F0.25z-^ 

0.1 -h0.04z-i -F0.05z"^ 

0.21Z-' - 0.05Z-2 

0.21z"i + 0.084Z-2 + 0.105z"^ 

-0.134z-2-0.105z~^ 

-0.134Z-2 - 0.0536z~^ - O.OeVz""* 

-O.OSUz-^ + 0.067 z-"^ 



(2.65) 
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From the coefficients in the quotient, we see that x(0) = 0.1, x(l) = 0.21, x(2) = 
—0.134, x(3) = —0.0514 and by continuing this procedure, we can get x(4), 
;c(5),.... 

The method of finding the few coefficients of the inverse z transform of a 
transfer function X(z) can be shown to have a recursive formula [1,6] which is 
given as follows. Let the transfer function X(z) be expressed in the form 



K -n 



The samples of the inverse z transform are given by the recursive formula 
1 



(2.66) 



flO 



bn — ^^x(n — i)ai 



1=1 



n= 1,2, .. 



(2.67) 



where xo = bo/oo. 



Property 2.5: Final Value To find the value of x(n), as n -> oo, we use 

Um x(N) = ]im(z- l)X(z) 
N-^oo z->-l 

when and if (z — l)X(z) has all its poles inside the unit circle. 

Proof: Consider X(z) = xiO) + xil)z~'^ + xi2)z~^ + ■ ■ ■. If we shift the 
sequence xiO), x{l), x{2), . . . to the left (i.e., advance it) by one sample, we 
have the sequence of values x(l) at n — 0,x(2) at n = 1, x{3) at n = 2, and so 
on. This sequence is represented as x{n+ 1), and the unilateral z transform of 
this sequence is 

Z[x{n + 1)] = xil) + x(2)z-i +x{3)z-^ + x{4)z-^ + ■■■ 

= z [x{l)z-^ + x(2)z-2 + xi3)z-^ + x(4)z-4 + - - ■] 
= z [-x(0) + x(0) + x(l)z-^ + x{2)z-^ + x{3)z-^ 

+ x(4)z-^ + ---] 
= z[-x(0) + X(z)] 



Let us express 

Z[x(n)] = lim x{n)z^'^ and Z[x{n + 1)] = Um x{n + l)z~ 



N N 



n=0 «=0 
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Then 



Z[xin + I)] - Z[xin)] 

" N 

J2{x(n + l)-x(n)}z-'' 



= lim 

N^oo 



.n=0 

= [(z - i)z(z) - zxm 



= z[-x(0) + Xiz)]-Xiz) 



Letting z -> 1, we get 

N 



lim 

N->-oo 



J2{x(n + l)-xin)} 



.n=0 



= lim [(z - l)A'(z) - zxm 



= Um [{xiN + I) - xiO)}] 

N^oo 

= lim [(z - l)Z(z) - x(0)] 

= x(oo) — x(0) 

where we have assumed that limA-^oo [{x(N + 1)}] = x(oo) has a finite or zero 
value. This condition is satisfied when (z — l)X{z) has all its poles inside the 
unit circle. Under this condition, we have proved that 

xioo) = lim[(z - l)Z(z)] 

Property 2.6: Multiplication by r" If we have Z[xin)u{n)] = X{z), then 
Z[r"xin)uin)] = X{z/r). 

Proof: 

Z\r"x{n)u{n)] = Y^r"x{n)z~'' = Y^x{n) (^)~" = X 



n=0 



n=0 



We have already used this property in deriving a few z transforms shown in 
Table 2.1. As another example, let Z[a'^u{n)] = z/{z — a). Then 



Z\r"a"u{n)'[ 



z — ra 



A few other properties have already been discussed in this chapter, and 
Table 2.3 summarizes the properties of z transforms. 
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TABLE 2.3 Properties of z Transforms 



Operation 



x(n)u(n) 



Addition 

Scalar multiplication 
Delay 



Time reversal 

Multiplication by n 
Multiplication by r" 
Time convolution 

Modulation 
Initial value 
Final value 



xi{n) + X2{n) 
Kx(n) 

x(n — l)u(n — 1) 
x{n — 2)u(n — 2) 
x(n — 3)u(n — 3) 

x(n — m)u{n — m) 
x{—n)u{—n) 

nx(n) 
r«jc(n) 
xi(n) * X2(n) 

xi(n)x2{n) 
x(0) 

limAr^oo-^(A'^) 



Xi{z) + X2{z) 
KXiz) 

z-^X(z)+x(-i) 
z-^X(z)+z-^x{-V)+x{-2) 
z-^Xiz)+z-^x{-\) + 
z-^x{-2)+x{-3) 

z-"'X{z) + j:':-^xin-m)z-'' 
X{z-') 
dX(z) 

X(r-h) 
Xi(z)X2(z) 

(l/27tj)JcXi{z)X2[^)u-'du 



lim,. 



oX(z) 



limj^i(z — l)X(z), when poles 
of (z — l)X(z) are inside the 
unit circle 



2.8 STABILITY 

It is essential that every system designed by an engineer be extremely stable in 
practical use. Hence we must always analyze the stability of the system under 
various operating conditions and enviroimients. The basic requirement is that 
when it is disturbed by a small input, the response of the system will eventually 
attain a zero or a constant value or at most be bounded within a finite limit. 
There are definitions for various kinds of stability, but the definition used most 
often is that the output asymptotically approaches a constant or bounded value 
when a bounded input is applied. This is known as the bounded input-bounded 
output (BIBO) stability condition. It satisfies the condition when the unit impulse 
response h(n) satisfies the condition YI'hLq < ■'Vf < oo. To prove this result, 

let us assume that H{z) = z/z — yt, where y,- is the pole of H{z). The unit 
impulse response is y" for n > 0: 

00 00 

n=0 n=0 

1 

= - — when < 1 

1 - In I 
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When H{z) = N{z)/Y\ti(^- " where Yi are the poles of H(z) such that 
< 1 for i = 1,2,3, K, we get 

00 ''^ 1 

n=0 ,=1 ^ 

Next consider an input x{n) that is bounded in magnitude: 

\x(n)\ < B for all n 



From the convolution property, we get 



k=—oo 



\ym= h{k)x{n-k) 

t=— 00 

Since \x {n)\ < B for all values of n and k, we get 

oo 

\yin)\ <Bj2\h(k)\ for all n 



^ |/i(/c)||x(n-^)| 



k=0 



Therefore, we conclude that if the impulse response is absolutely summable, that 
is, if 



< oo 



«=0 



then the output y{n) is bounded in magnitude when the input x(n) is bounded 
and the system is BIBO-stable. 

There are a few tests that we can use to determine whether the poles of a 
transfer function 



Hiz) = 



% + +b2Z-^ + ■■■ + bMZ 



-M 



ao + aiz ^+a2Z ^ + a^z ^ + a^z ^^ \- aj^z 



ooz^ + aizA'-i + a2Z^-2 + ■ ■ ■ + 
are inside the unit circle in the z plane. 



2.8.1 Jury-Marden Test 

To determine whether the poles are inside the unit circle in the z plane, we 
choose the Jury-Marden test [1,4] because it has some similarity with the 
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TABLE 2.4 The Jury-Marden Array of Coefficients 



Row Coefficients 



1 


ao 


a\ 


a2 ■ ■ ■ ^N—\ 


On 


2 


On 


on-i 


Un-I . . . fll 


ao 


3 


Co 


Cl 


C2 . . . 


cn-1 


A 
H 


CN-l 


CN-2 


. . . Cl 


Co 


5 


do 


di 


d2-- ■ dN-2 




6 


dN-2 


dN-3 


...do 




7 
8 










2N-3 


ro 


ri 


r2 





Routh-Hurwitz test that the students have learned from an earlier course, and it 
is easier than the other tests that are available.^ 

We consider the coefficients of the denominator arranged in descending pow- 
ers of z, specifically D(z) = aoz^ + aiz'^^' + a2Z^^^ + ■ ■ ■ + Uf^ where > 0. 
The first row of the Jury-Marden array lists the coefficients ao, ai, a2, . . . , 
(see Table 2.4), and the second row lists these coefficients in the reverse order. 
On, ciN-i, aN-2, . . . , (32, «i,«o So we start with the two rows with elements 
chosen directly from the given polynomial as follows: 



The elements of the third row are computed as second-order determinants 
according to the following rule: 



Ci = 



For example 



Co 



Cl = 



C2 



for i = 0, 1,2, 



(N-l) 









UN 


ao 




ao 




1 


On 


fll 




ao 




2 




ai 





' However, in Chapter 6 we describe tiie use of a MATLAB function tf 21atc, whicii is based on 
the Schur-Colin test. 
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Note that the entries in the first column of the determinants do not change as / 
changes in computing c, . The coefficients of the fourth row are the coefficients 
of the third row in reverse order, as shown in the array below. The elements of 
the fifth row are computed by 



di = 



For example 



Co CN^i^i 
CN-1 Ci 



do = 
di = 
d2 = 



for i = 0,1,2,..., {N -2) 



Co 


Cn 


CN-1 


Co 


cq 


Cn 


CN-i 


Cl 


Co 


Cn 


CN-1 


C2 



and the elements of the sixth row are those of the fifth row in reverse order. 
Note that the number of elements in these rows are one less than those in the 
two rows above. As we continue this procedure, the number of elements in each 
successive pair of rows decreases by one, until we construct (2N — 3) rows and 
end up with the last row having three elements. Let us denote them as ro, ri, ri. 

The Jury-Marden test states that the denominator polynomial D{z) = aoz" + 
aiz"~^ + ■ ■ ■ + aN has roots inside the unit circle in the z plane if and only if the 
following three conditions are satisfied. Note here that we need to express the 
denominator polynomial in positive powers of z, because we have to evaluate it 
at z = ±1 in the first two criteria shown below: 



1. D(l) = D{z)\,=, > 0 

2. (-l)'^D(-l) > 0 

3. ao > {unI 

Also 

Icq I > Icjv-ll 
\do\ > \dN-2\ 

kol > kil 

Example 2. 19 

Let us consider the denominator polynomial D(z) = 5z^ + 4z^ + 3z^ + + 
z + I. We construct the Jury-Marden array following the method described 
above: 
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Row 




Coefficients 








1 


5 


4 




1 


1 


1 


2 


1 


1 


1 


3 


4 


5 


3 


24 


19 


14 


2 


1 




4 


1 


2 


14 


19 


24 




5 


575 


454 


322 


29 






6 


29 


322 


454 


575 






7 


329784 


251712 


171984 









Check whether the three test criteria are satisfied: 



Z)(l) = D{z)\,=i = 15(-l)^/?(-l) = 3 





= 5; 


as = 


1; 


ao 


> 


1^5 


Co 


= 24; 


C4 = 


1; 


kol 


> 


|C4 


do 


= 575; 


(is = 


29; 


141 


> 


1* 




= 329784; 


r2 = 


171984; 


kol 


> 


|r2 



All criteria are satisfied, and therefore the D(z) above has its five zeros inside 
the unit circle. 

Example 2.20 

Now consider another example: D{z) = 3z^ + 5z^ + 3z^ + 2z + 1. The Jury- 
Marden array is constructed as shown below: 



JURY-MARDEN ARRAY 



Row 1 


3 


5 


3 


2 


2 


1 


2 


3 


5 


3 


8 


13 


6 


1 


4 


1 


6 


13 


8 


5 


63 


98 


35 





Although we have calculated all the entries in the array, we find that the second 
criterion is not satisfied because (— 1)'*D(— 1) = 0. We conclude that there is at 
least one zero of D(z) that is not inside the unit circle. Indeed, it is found that 
there is one zero at z = —1.000. It is a good idea to check at the beginning, 
whether the first two criteria are satisfied, because if one or both of these two 
criteria (which are easy to check) fail, there is no need to compute the entries in 
the rows after the first two rows of the Jury-Marden array. 



2.9 SOLUTION USING MATLAB FUNCTIONS 

In the previous sections, we have described many models for the discrete-time 
system and discussed three methods of finding the output of the system when 
the input sequence is given, along with initial conditions in some cases. 
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The three methods are 

1. Recursive algorithm 

2. Convolution sum 

3. z-Transform method 

In this section, we illustrate the use of MATLAB functions to implement some of 
the algorithms discussed in the previous sections. At this point it is strongly sug- 
gested that the students review the MATLAB primer in Chapter 9 to refresh their 
understanding of MATLAB, although it is only an introduction to the software. 

First let us consider the case of a system described by the hnear shift-invariant 
difference equation 

y{n) = OAy{n - 1) + 0.05y{n - 2) + x{n) 

where the initial states are given as yi—l) = 2 and y(—2) = 1.0. We learned 
how to find the output of this system for any given input, by using the recursive 
algorithm. Assuming x(n) = S(n) and the initial two states in this example to 
be zero, we found the unit impulse response h(n). Knowing the unit impulse 
response, we can find the response when any input is given, by using the convo- 
lution algorithm. It was pointed out that convolution algorithm can be used to find 
only the zero state response since it uses h(n), whereas the recursive algorithm 
computes the total response due to the given input and the initial states. 

Now we use the z transform to convert the difference equation above to get 

Yiz)[l - 0.4Z-1 - 0.05Z-2] = OAy{-l) + 0.05[z-V(-l) + y(-2)] + Z(z) 

= [0.8 + O.U-i +0.05] + Z(z) 

Therefore 

0.85-l-O.lz-' X(z) 
^^^-^ ~ [1 - 0.4Z-1 - 0.05Z-2] ^ [1 - 0.4Z-1 - 0.05Z-2] ^^'^^^ 
= YQdz) + Yo,(z) (2.69) 
= Yoi(z) + H{z)X(z) 

We obtain the transfer function H(z) = 1/[1 — 0.4z~' — 0.05z~^] from the given 
linear difference equation describing the discrete-time system. 

But when we decide to use MATLAB functions, note that if the given input is a 
finite-length sequence x(n), we can easily find the coefficients of the polynomial 
in the descending powers of z as the entries in the row vector that will be 
required for defining the polynomial X(z). But if the input x{n) is infinite in 
length, MATLAB cannot find a closed-form expression for the infinite power 
series Z(z) = X!J^o-*(")^~"' ^^^^ fi"'^ numerator and denominator 
coefficients of X{z). 
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Example 2.21 

As an example, let us assume that x(n) = [(—0.2)" + 0.5(0.3)"]m(«). We have 
to derive its z transform as 



7 0 57 

^(^) = ^?T^ + -^ (2.70) 
7 + 0.2 7 — 0.3 



1.57^-0.27 
7^-0.17-0.06 

1.5-0.27-' 
1 -O.I7-1 -O.O67-2 



(2.71) 
(2.72) 



Using (2.70), we have 

0.85 + O.U- 



[1 - 0.47-1 - 0.057-2] 

+ (2 73) 

[1 - 0.47-1 - 0.057-2][l - O.I7-1 - O.O67-2] ■ 

We illustrate the use of MATLAB function conv to find the product of two 
polynomials in the denominator of Iq; (z) 

den2=conv (dl , d2 ) 

where the entries for the row vectors di and d2 are the coefficients in ascending 
powers of for the two polynomials [1 — O.47-1 — 0.057"^] and [1 — 0.l7~^ — 
0.067-2]. 

So we use the following MATLAB statements to find the coefficients of their 
product by convolution: 

dl= [1 -0.4 -0 . 05] ; 
d2= [1 -0.1 -0.06] ; 
den2=conv (dl , d2 ) . 

MATLAB gives US the vector den2 = [1.00 -0.50 -0.07 0.029 0.003]. 
Example 2.22 

We introduce three MATLAB functions residuez, impz, and filter, which 
are very useful in time domain analysis of discrete-time systems: 



[r,p,k] =residuez (num,den) 
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This function gives us the partial fraction expansion of the z transform 

= ^ = bo + b,z-' + b2Z-' + --- + bMZ-'' 
' A(z-i) \ + arz-^+a2Z-^ + a^z-^ + --- + bNZ-'' ' 

in the form 

ki+k2Z +k2Z H 1- 77" r + -; — r H h 



1 - p(l)z-i 1 - p(2)z-i 1 - p(N)z-^ 

(2.75) 

which can be expressed in a more famihar form: 

ki+k2Z +k2Z H 1 -— H -r- H h 



z - pil) z - p{2) z - p{N) 

The vector num=[feo b\ ^i-.-^m] and the vector den=[l ai 02 «3 
. . .a^] list the coefficients of the numerator and denominator polynomial in 
ascending powers of z~'. In the output, the vectors r and p list the residues and 
corresponding poles, while k is the vector of gain constants which are present 
when M > A^. If there is a pole p{j) of multipUcity m, then the partial fraction 
expansion will show terms in the form 

r{j) ^ r{j + 1) ^ rjj + 2) ^ ^ r(j + m- 1) 



[1 - pU)z-'] [1 - pU)z-^f [1 - pU)z-^f [1 - pU)z-T 

(2.76) 

After we have obtained the partial fraction expansion, we can express the inverse 
z transform for each of its terms to get y(n) for all n > 0. This is one method 
for finding the response of the discrete-time system. 

Instead of this procedure, we can use the MATLAB function impz to obtain 
the response y(n), but this procedure yields the value of the response y(n) for 
only a finite number of samples n = 0, 1, 2, 3, . . . , A": 



ly, T] =impz (num, den, K) 



In this function, the column vector T — [0 1 2 3 ... K]' and the colunm 
vector y gives us the K samples of the inverse z transform of F(z~') = y(n). 
We can then plot the samples in y{n) using the function stem(T,y) . If we use 
only the command impz (num, den, K) , without the output arguments, we will 
get the plot of y{n) immediately. 

The third MATLAB function that we use is filter, which gives us the 
output yin) of the system with a transfer function Hiz"^) when its input is a 
finite sequence xin): 



y =f ilter (num, den, x) 
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So we enter the samples of the input in the row vector x, besides the vectors for 
the coefficients of num and den of H(z~^). When the vector x is simply 1, the 
output vector y is obviously the unit sample response h(n). This function even 
allows us to find the output when initial states are given, if we use 



[y, F] =f liter (num, den, x, Iq) 



where lo is the vector listing the initial conditions and f is the final value. It is 
important to know that although the transfer function H{z~^) is the z transform of 
the zero state response, the function filter implements the recursive algorithm 
based on the transfer function and can find the total response when initial states 
are also given. So this function is a more useful function in signal processing 
applications. 

Example 2.23 

Let us consider the z transform of the zero input function found in (2.73): 

1 0.85 + 0.1?-' 

Yoi iz'^) = ^1 T- (2.77) 

[1 - 0.4Z-1 - 0.05Z-2] 

To find the partial fraction expansion, we use the following MATLAB script: 

num= [0.85 0.1] ; 
den=[l -0.4 -0.05] ; 
[r,p,k] =residuez (num, den) 

and we get 



r = 0.8750 

- 0.0250 
p = 0.5000 

- 0.1000 



So the partial fraction expansion of FoiCz"^) = 0.8750z/(z - 0.5) - 0.025z/ 
(z-hO.l). Therefore the zero input response yoi(«) = [0.8750(0.5)" - 0.025 
(-0.1)"] M(n). 



Example 2.24 



To find the 20 samples of the zero input response yo, (n) directly from (2.77), we 
use the function impz in the following script: 
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num= [0.85 0.1] ; 
den= [1 -0.4 -0 . 05] ; 
[y/T]=impz (num, den, 20) 

and we get the samples of output yoi (n) as 

y = 0.8500 
0.4400 
0.2185 
0.1094 
0.0547 
0.0273 
0.0137 
0.0068 
0.0034 
0.0017 
0.0009 
0.0004 
0.0002 
0.0001 
0.0001 
0.0000 
0.0000 
0.0000 
0.0000 
0.0000 

Example 2.25 

As the second example, we consider the z transform of the zero state response 
Yosiz'^) in (2.73) and use the following MATLAB program to find the partial 
fraction expansion: 



SOLUTION USING MATLAB FUNCTIONS 



87 



dl= [1 -0.4 -0 . 05] ; 
d2= [1 -0.1 -0.06] ; 
den2=conv (dl , d2) . 
num= [1.5 -0.2] ; 
[r,p.k] =residuez (num,den2) ; 

The output from the program is 

r = 1.6369 

- 0.5625 
0.5714 

- 0.1458 
p = 0.5000 

0.3000 

- 0.2000 

- 0.1000 



Therefore the partial fraction expansion is given by 

, 1.6369Z 0.5625Z 0.5714z 0.1458z 
z — 0.5 z — 0.3 z-l-0.2 z -1-0.1 

and the zero state response 

_yos(n) = [1.6369(0.5)" - 0.5625(0.3)" + 0.5714(-0.2)" - 0.1458(-0.1)"] M(n) 



Example 2.26 



To find the zero state response by using the function filter, we choose an input 
of finite length, say, 10 samples of 



x{n) = [(-0.2)" + 0.5(0.3)"] for n = 0, 1, . . . , 9 



we use the following script: 
n=(0:9) ; 

x= [ (-0 .2) . ^n+0 .5* (0.3) . ; 
y=f liter (b, a, x) 



88 



TIME-DOMAIN ANALYSIS AND z TRANSFORM 



The output yos(n) is 

y = columns 1-7: 

1.5000 0.5500 0.3800 0.1850 0.0987 0.0496 0.0252 
columns 8-10: 
0.0127 0.0064 0.0032 

We compute 10 samples of the response obtained from the partial fraction 
expansion method: 

yo,(n} = [1.6369(0.5)" - 0.5625(0.3)" + 0.5714(-0.2)" - 0.1458(-0.1)"] 

for n = 0, 1 , 2, ... 9, using the following program and find that the result agrees 
with that obtained by the function filter: 

n= (0:9) ; 

y= [1.63 69* (0.5) .*n- 0.562 5* (0.3) .^n+0.5714* (-0.2) . 0.1458* ( 
-0.1) ."n] 

The output is 

y = columns 1-7: 

1.5000 0.5500 0.3800 0.1850 0.0986 0.0496 0.0252 

columns 8-10: 

0.0127 0.0064 0.0032 

Example 2.27 

Now let us verify whether the result from the function impz also agrees with the 
results above. We use the script 

dl= [1 -0.4 -0 . 05] ; 
d2= [1 -0.1 -0 . 06] ; 
den2=conv (dl , d2 ) . 
num= [1.5 -0.2] ; 
[Y/T] =impz (num,den2) 

We get the following result, which also agrees with the results from the pre- 
ceding two methods: 

y = 1.5000 
0.5500 
0.3800 
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0.1850 
0.0986 
0.0496 
0.0252 
0.0127 
0.0064 
0.0032 
0.0016 
0.0008 
0.0004 
0.0002 



Example 2.28 



To find the unit impulse response h{n) using the function filter, we identify 
the transfer function //(z"') in (2.73) as 1/[1 - OAz~^ - 0.05^-2]. 
From the MATLAB program 

b= [1] ; 

a= [1 -0.4 -0 . 05] ; 

[r,p, k] =residuez (b, a) , 
we get 

r = 0.8333 
0.1667 
p = 0.5000 
-0.1000 
k = [] 

From this data output, we express the transfer function 

_i 0.8333Z 0.1667Z 

and the unit impulse response of the system is 

h(n) = [0.8333(0.5)" -0.1667(-0.1)"]M(n) 
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To find the unit impulse response using the function impz, we use 

b= [1] ; 

a= [1 -0.4 -0 . 05] ; 
[y,T] =impz (b,a,20) 

and get 

y = 1.0000 
0.4000 
0.2100 
0.1040 
0.0521 
0.0260 
0.0130 
0.0065 
0.0033 
0.0016 
0.0008 
0.0004 
0.0002 
0.0001 
0.0001 
0.0000 
0.0000 
0.0000 
0.0000 
0.0000 

Example 2.29 

To get the same result, using the function filter, we use x =[i zeros (i, 
19) ] which creates a vector [looooooooooooooooooo]: 



b= [1 0 0] ; 

a= [1 -0.4 -0 . 05] ; 
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x= [1 zeros (1,19] ; 
y=f liter (b, a, x) 

The output is 

y = columns 1 -7: 

1.0000 0.4000 0.2100 0.1040 0.0521 0.0260 0.0130 
columns 8-14: 

0.0065 0.0033 0.0016 0.0008 0.0004 0.0002 0.0001 
columns 15-20: 

0.0001 0.0000 0.0000 0.0000 0.0000 0.0000 

Example 2.30 

Now we consider the use of the function residuez when the transfer function 
has multiple poles. Let us choose G(z) from (2.44) and (2.45) and also reduce 

it to a rational function in ascending powers of as shown in (2.80): 



z(2z^-llz + 12) 
iz -IKz- 2)3 

(z - 2y (z - ly (z - 2) iz - 1) 

2z^ - llz^+Uz 



Giz) 



z^ - 7^3 + I8z2 - 20z + 8 
_ 2z-i - 1U-2 + 12z-3 
~ 1 - 7z-i + 18z-2 - 20z-3 + 8z-4 

The program used to obtain the partial fraction expansion is 

b= [0 2 -11 12] ; 
a= [1 -7 18 -20 8] ; 
[r,p,k] =residuez (b,a) 

and the following is the output data we get: 

r= 3.0000 + 0.0000/ 
0.5000 - O.OOOOi 

- 0.5000 

- 3.0000 



(2.80) 
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p = 2.0000 + O.OOOOj 
2.0000 - O.OOOOj 
2.0000 
1.0000 

fe = [] 

From these data, we construct the partial fraction expansion as 

3 0.5 0.5 3 

Gl(z) = T—f- + 



(1-2Z-1) (l-2z-i)2 (l-2z-i)3 (1-z-i) 
which can be reduced to the equivalent expression 

G(z) = ^+ 0.5z^ 0.5z3 3z 



(z-2) (z-2)2 (z-2)3 (z-1) 

which differs from the partial fi-action expansion shown in (2.45) or (2.79). But 
let us expand 



0.5z^ 



(2-2)2 

and 



0.5z 

+ 



(z-2)2 iz-2)_ 
0.5z^ -2z 2z 0.5z 



(z-2)3 (z-2)3 (z-2)2 (z-2) 



Substituting these expressions in the preceding form for G(z), we get 

^, -2z z 3z 3z 



(z-2)3 (z-2)2 (z-2) (z-1) 
which is exactly the same as the form obtained in (2.79). 

Example 2.31 

We can use a MATLAB function deconv (b , a ) to find a few values in the inverse 
z transform of a transfer function, and it is based on the recursive formula given 
by (2.65). Let us select the transfer function (2.67) to illustrate this function. 
%MATLAB program to find a few samples of the inverse z transform 

b = [0.1 0.25 0] ; 
a = [10.4 0.5]; 

n = 5; 

b= [b zeros (1, n-1)]; 
[x,r] = deconv (b, a) 
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where 

jc = 0.1000 0.2100 -0.1340 -0.0514 
r = 0 0 0 0 0.0876 0.0257 

From these output data, we get 

^(^) = , 9 = 0-1 + 0-21^"^ - 0.134Z-2 - 0.0514Z-3 

1 + 0.4z-i + 0.5z-2 

O.OSez""* - 0.0257z-^ 
1 + 0.4Z-1 + 0.5z-2 ■ 

Therefore we get jcq = 0.1, xi = 0.21, JC2 = —0.134, = —0.0514, which agrees 
with the result obtained from long division, by hand calculation. Note that the 
vector b has to be augmented by (n — 1) zeros in the above program above, as 
pointed out by Ifeachor and Jervis [6]. 

Students may find it useful to know the following additional MATLAB func- 
tions in their analysis of discrete-time systems, in addition to those used in the 
examples above presented. Given a vector of zeros, the coefficients of the poly- 
nomial having these zeros is obtained by the function poly. A complex number 
entered as a zero must be accompanied by its conjugate so that the coefficients 
become real. Given the coefficients of the polynomial in a row vector, its zeros 
are found from the function roots. The poles and zeros of a rational function 
F(z) are plotted in the z plane by the function zplane. Two other functions 
that may be interesting to the students are tfdata and tf. Typing the com- 
mands help poly, help roots, help zplane, help tfdata, and help tf 
will display the details for using these commands. A list of all MATLAB func- 
tions available in the Signal Processing Toolbox is displayed when the command 
help signal is typed in the command window and is given in the MATLAB 
primer in Chapter 9. Typing Type functionname displays the MATLAB code 
as well as the help manual for the function where functionname is the name of 
the function. Using the help command, students become familiar with and pro- 
ficient in the use of MATLAB functions that are available for conducting many 
tasks in the analysis and design of discrete-time systems. It is only by trying as 
many functions in MATLAB and the Signal Processing Toolbox as possible that 
one becomes familiar with and proficient in their use, and the books by Ingle and 
Proakis [9] and Mitra [10] are highly recommended for this purpose, in addition 
to the functions we have included in this textbook. 



2.10 SUMMARY 

In this chapter, we have described several ways of modeling linear shift-invariant 
discrete-time systems, highlighting that we should learn how to obtain the one 
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model from other models that is appropriate for solving a given problem in the 
time-domain analysis of the system. The recursive algorithm and the convolution 
sum were described first; then the theory and application of z transform was 
discussed in detail, for finding the response of the system in the time domain. 
In this process, many properties of the z transform of discrete-time signals were 
introduced. Some fundamental concepts and applications that we discussed in 
this chapter are (1) using a recursive algorithm to find the output in the time 
domain, due to a given input and initial conditions; (2) finding the output (zero 
input response, zero state response, natural response, forced response, transient 
response, steady-state response, etc.) of a discrete-time system from a linear 
difference equation (or set of equations), using the z transform; (3) finding the 
transfer function and the unit impulse response of the system; and (4) finding 
the output due to any input by means of convolution sum. We also showed the 
method for obtaining the single input-output relation from the transfer function 
and then solving for the zero input and zero state response by introducing the 
initial conditions of the output into the linear difference equation. 

The concept of stability and a procedure for testing the stability of a discrete- 
time system was discussed in detail and followed by a description of many 
MATLAB functions that facilitate the time-domain analysis of such systems. In 
the next chapter, we consider the analysis of these systems in the frequency 
domain, which forms the foundation for the design of digital filters. 



PROBLEMS 

2.1 Given a linear difference equation as shown below, find the output y{n) 
for 0 < n < 5, using the recursive algorithm 

y{n) = 03yin - 1) + yin -2)+ x(n) 

where >'(-I) = I.O, y(-2) = 0 and x(n) = (0.1)"M(n). 

2.2 An LTI-DT system is described by the following equation 

yin) = 0.3y(n - 1) + yin - 2) - O.lyin -3)+ xin) 

where ^(-1) = 1, yi-2) = 0, y(-3) = 2, and x{n) = (0.5)"u(n). Find 
the output samples yin) for 0 < « < 5, using the recursive algorithm. 

2.3 An LTI-DT system is described by the recursive equation 

yin) = -0.5y(n - I) + 0.06>'(« - 2) -|- xin) 

where }'(— 1) = 0; yi—2) = 0 and xin) = cos(0.5:T«)M(n). Find the out- 
put yin) for 0 < n < 5, using the recursive algorithm. 
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2.4 An LTI-DT system is described by the difference equation 

yin) + 0.5yin - 1) + 0.06y{n - 2) = 2x(n) - x{n - 1) 

wherejC-l) = 1.5,>'(-2) = -1.0,andx(«) = (0.2)"M(n). Find the out- 
put sample 3^(4) using the recursive algorithm. 

2.5 What are the (a) zero state response, (b) zero input response, (c) natu- 
ral response, (d) forced response, (e) transient response, (f) steady-state 
response, and (g) unit impulse response of the system described in Prob- 
lem 2.4? 

2.6 Given an input sequencer (—3) = 0.5, x(— 2) — 0.1,x(— 1) — 0.9, x(0) = 
1.0,jc(l) = 0.4,x(2) = -0.6,and/2(n) = (0.8)"M(n), find the output jCn) 
for —5 <n < 5, using the convolution sum. 

2.7 Find the samples of the output y{n) for 0 < n < 4, using the convolution 
sum );(«)= * ft («), where = {1.0 0.5 -0.2 0.4 0.4} 

and h{n) = (0.8)"M(n). 

2.8 Given an input sequence x(n) = [-0.5 0.2 0.0 0.2 - 0.5} and 

t 

the unit impulse response h{n) = {0.1 —0.1 0.1 —0.1}, find the 

t 

output using the convolution sum, for 0 < n < 6. 

2.9 Given an input x(n) = (0.5)"u{n) and h(n) — (0.8)"m(«), find the output 
y(n) for 0 < « < 4, using the convolution sum formula and verify that 
answer by using the z transforms X{z) and H(z). 

2.10 When a; (n) = {1.0 0.5 -0.2 0.4 0.4}, and = (0.8)"M(n), 

t 

find the output y(n) for 0 < n < 6, using the convolution formula. 

2.11 Find the output yin) using the convolution sum formula, y{n) = vin) * 
x{n), where v{n) = i—l)"u{n) and x(n) = (—l)"u{n). 

2.12 Find the output sample ^(3), using the convolution sum formula for 
y(n) = x{n) * ft(n),where x{n) = e^-^"u(n) and h(n) = e~^-^"u{n). 

2.13 Find the output y{5), using the convolution sum, when an LTl-DT system 
defined by h{n) = (0.5)"M(n) is excited by an input x{n) — (0.2)"; 2 < 
n < oo. 

2.14 Givenft(n) = (-l)"M(n)andx(«) = {0.1 0.2 0.3 0.4 0.5 0.6}, 

t 

find the value of yin) = xin) * hin) at n = 3, from the convolution sum. 

2.15 An LTI, discrete-time system is defined by its hin) — (0.8)"M(n). Find 

the output yin) for n = 1, 2, 3, 4, when the input is given by xin) = 

{1.0 0.5 - 0.5 0.2 0.2 0.4 0.6 0.8}, using the convolution 
t 

sum. 
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2.16 (a) Plot the output y(n) for -3 < n < 3, when x{n) = {1.0 0.5 0.0 

t 

0.5 1.0} is convolved with h(n) = (—l)"u{n). 
(b) Plot the output y(n) for -4 < n < 4, when x{n) = (-l)"M(-n + 3) 
is convolved with h(n) = (— l)"M(n — 2). 

2.17 The input sequence is jc(n) = {1.0 - 0.5 1.0 -0.5 1.0 - 0.5 

t 

1.0 — 0.5} and the unit pulse response h{n) = {0.1 0.2 0.3}. Find 

t 

the output sample ^(l) and y(4), using the convolution sum formula. 

2.18 Show that the z transform of x(n) = (n + l)a"u(n) is X{z) = 

2.19 Find the z transform of the following sequences: 

(a) xi{n) = (0.1)"-^ uin) 

(b) X2in) = (0.1)"M(n-3) 

(c) x^in) = cos(0.57r«)M(n) 

2.20 Find the z transform of the following two functions: 

(a) xi{n) = n{0.5f-^uin) 

(b) X2(n) = (0.5)"M(n - 2) 

2.21 Find the z transform of the following two functions: 

(a) xi(n) = —na"u(—n — 1) 

(b) X2in) = (-1)" cos(f n)M(«) 

2.22 Find the z transform of the following functions: 

(a) xiin) = (-l)"2-«M(n) 

(b) xxin) = na" sin(coon)u(n) 

(c) x^in) = (n^ + n)a"~^u(n — 1) 

(d) X4(n) = (0.5)" [M(n) - uin - 5)] 

2.23 Show that 



2.24 Find the z transform of an input x{n) = i—l)"[u{n — 4) — u(n — 

8)]. When an LTI, discrete-time system, defined by its h{n) = {1.0 

t 

0.8 0.6 0.4}, is excited by this x(n), what is the output yin); w > 0? 

2.25 An LTI discrete-time system has an unit pulse response h(n) = 
(0.l)"u(n). What is its output y{n) when it is excited by an input 

x(n) = (n + l)(0.5)"M(n)? 



2.26 Find the inverse z transform of Hiz) = 0.3z + l.O/[iz + 0.5){z + 
0.2)2(z + 0.3)]. 



N 



when z = 1 



X(z) = l + z-'+z-' + --- + z-^''-'^ 




when z 7^ 1 
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2.27 Find the inverse z transform of H{z) = 0.6z/[(z + 0.1)(z - O.S)^]. 

2.28 Find fin) from F(z) = (z + 0.3)/z(z + 0.5)2. 

2.29 Find the inverse z transform of Xiz) = z(z + 0.5)/iz^ + 0.6z + 0.5). 

2.30 Find the inverse z transform of X(z) = (z + 0.2)/[(z + 0.5)(z - 1) 
(z-O.l)]. 

2.31 Find the inverse z transform of Yiz~^) = (z"^ + OAz~^)/il + z~^ + 
0.25Z-2). 

2.32 Find the inverse z transforms of the following two transfer functions; 

z + 0.6 



Hiiz) = 
Hiiz) = 



(z2 + 0.8z + 0.5)(z-0.4) 
(z + 0.4)(z + 1) 



(z - 0.5)2 

2.33 Find the inverse z transform of H(z) = z/[(z + 0.5)2(z2 + 0.25)]. 

2.34 Find the inverse z transform of H(z) = [0.1z(z + l)]/[(z - l)(z^ -z + 
0.9)]. 

2.35 Find the inverse z transform of F(z) = (z + 0.5)/z(z2 + 0.2z + 0.02). 

2.36 Find the inverse z transform of the following two functions: 

1 + 0.1Z-1 +0.8Z-2 



Gi(z) = 
Giiz) = 



0.2z2 + z+ 1.0 
(z + 0.2)(z + 0.1) 



2.37 Find the inverse z transform of Z(z) = (3.0 + 1.35z~^ + 0.28z~2 + 
0.03z-3)/(1.0 + 0.5z-' + 0.06Z-2). 

2.38 Show that the inverse z transform of Hiz) = 1/[1 - 2r(cos6')z"' + 
r'^z~'^] is given by 

r"sin(n+l)0 

Hn) = — m(«) 

sm9 

2.39 Show that the inverse z transform of H{z) = z/iz — a)^ is given by 

n(n - l)a"-2 
h{n) = u{n — 2) 
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2.40 Given an LTI-DT system described by 

yin) + 0.25yin - 2) = xin - 6) 

where yi—l) = 1, yi—2) = 0, and x{n) = u{n), find the (a) zero state 
response, (b) zero input response, (c) natural response, (d) forced 
response, (e) transient response, and (f) steady-state response of the 

system. 

2.41 Given an LTI discrete-time system described by 

y(n) + 0.2y(n - 1) + 0.2y(n - 2) = 0.5x(n - 1) 

where ^(-1) = 1, ^(-2) = -2, and x(n) = (-0.3)«M(n), find the 
(a) zero state response, (b) zero input response, (c) natural response, 
(d) forced response, (e) transient response, and (f) steady-state response 
of the system above. What is the unit pulse response h{n) of this system? 

2.42 An LTI discrete-time system is described by its difference equation 
y{n) - 0.09y{n - 2) = u{n), where yi-1) = 1 and y(-2) = 0. Find its 
(a) zero state response, (b) zero input response, (c) natural response, 
(d) forced response, (e) transient response, and (f) steady-state response, 
and (g) the unit pulse response. 

2.43 Given an LTI discrete-time system described by 

y(n) = -0.2y(n - 1) -|- 03yin -2) + O.lyin -3)+ 0.5x(«) + xin - I) 

where y(-l) = I, y(-2) = 1, y(-3) = 2, and = (0.5)"M(n), find 
its transfer function H{z). 

2.44 Given an LTI discrete-time system described by the difference equation 

yin) + 0.6yin - 1) + 0.25y(n - 2) = xin) + 0.04x(n - 2) 

where yi-l) = 0, ^(-2) = 0.4, and xin) = (-1)"m(«), find the (a) nat- 
ural response, (b) forced response, (c) transient response, and (d) steady- 
state response of the system. 

2.45 Given an LTI-DT system defined by the difference equation 

yin) - O.Syin - I) + OMyin - 2) = uin) 

and yi—l) = yi—2) = 0, find its (a) natural response, (b) forced 
response, (c) transient response, and (d) steady-state response, when it is 
excited by xin) = uin). What is its unit impulse response 
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2.46 Find the total response y{n) of the LTI-DT system defined by the fol- 
lowing difference equation 

yin) + 0.25yin - 1) + y(n - 2) = (0.5)"M(n) 

where y(— 1) = 1 and y(— 2) = — 1 

2.47 Find the total response y(n) for the LTI system given by y(n) + lAy(n — 
1) + 0A4y(n - 2) = 0.5<5(n - 2), where ^(-l) = 1 and y{-2) = 0.5 
are the initial states. 

2.48 Repeat Problem 2.47 for the system described by the difference equation 

y(n) + 0.5y(n - 1) + OMy{n - 2) = x{n) 

where ^(-1) = 0, yi-2) = 0, and = {1.0 0.5 - 1.0}. 

t 

2.49 Solve the following difference equation for yin),n >0 

y(n) + 0.6yin - 1) - OAyin - 2) = 2x(« - 2) 

where j(-l) = 1, yi-2) = 0.5, and = (0.1)"M(n). 

2.50 Given an LTI, discrete-time system described by the difference equation 

yin) + OAyin - 1) + O.OAyin - 2) = xin) - O.Sxin - 1) 

where yi— I) = 2, y(— 2) = 2,andjc(n) = (e~'^-^")M(n), find its unit pulse 

response hin). 

2.51 The difference equation describing an LTI discrete-time system is given 
below. Solve for yin) 

yin) + OAyin - 1) + Omyin - 2) = xin - 2) 

where yi-l) = 1, yi-2) = 1, and xin) = (0.5)"m(k). 

2.52 Find the total response yin) of the discrete-time system described by the 
following difference equation 

yin) - 0.3yin - I) + 0.02y(n - 2) = xin) - 0.1x(« - 1) 

where ^(-1) = 0, yi-2) = 0, and xin) = (-0.2)"M(n). 

2.53 Repeat Problem 2.52, assuming that the system is described by the dif- 
ference equation 

yin) - 0.04yin -2) = xin - I) 
where yi-l) = -0.2, yi-2) = I.O, and xin) = (0.2)«M(n). 
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2.54 An LTI discrete-time system is described by the following difference 
equation 

yin) + 0.25yin - 2) = xin - 1) 

where y(-l) = 0, yi-2) = 2, and xin) = (0.5)"u{n). Calculate the 
(a) zero state response, (b) zero input response, (c) natural response, 
(d) forced response, (e) transient response, and (f) steady-state response 
of the system. 

2.55 Given an LTI discrete-time system described by the difference equation 

yin) - O.Syin - 1) = xin) + O.Sxin - 1) 

where yi—l) = 2 and xin) = (0.5)"M(n), find yin) and also the unit 
impulse response hin). 

2.56 Given the transfer function Hiz) = z/[iz — l)^(z + 1)] of a digital filter, 
compute and plot the values of hin) for n = 0, 1, 2, 3, 4, 5. What is the 
value of lim„_^oo/z(n)? 

2.57 Given the input Xizr^) = 1.0 + O.U"' + 0.2z~^ and the transfer func- 
tion Hiz) = z/[iz - 0.2)(z -I- 0.3)], find the output yin). 

2.58 If the z transform of yin) = xin) * hin) is Xiz)Hiz), what is the con- 
volution sum formula for xi—n)*hin)l What is the z transform of 
xi—n) * hin)? 

2.59 Given an LTI discrete-time system described by the difference equation 

yin) = 4cos(0.4)>'(n - 1) - 4yin - 2) + xin) 

find hin) and the zero state response when xin) = uin). 

2.60 Derive the transfer function Hiz.) of the LTI discrete-time system 
described by the circuit shown in Figure 2.8. 

2.61 Derive the transfer function Hiz) of the LTI-DT system described by the 
circuit given in Figure 2.9. Obtain the difference equation relating the 
input xin) to the output yin). 

2.62 Derive the single input-single output relationship as a difference equation 
for the LTI-DT system shown in Figure 2.10. 

2.63 Obtain the transfer function Hiz) = Y^iz)/Xiz) as the ratio of polyno- 
mials, for the discrete-time system shown in Figure 2.11. 

2.64 Write the equations in the z domain to describe the LTI-DT system shown 
in Figure 2.12. and find the z transform Y^iz). 
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X(z) 



X{n) 



2.0 



1.5 



-0.5 

Figure 2.8 Problem 2.60. 



Figure 2.9 Problem 2.61. 



-Y(z) 




X(n) 



1.0 



-0.5 



[>^@ ^Y(n) 

0.5 



0.3 



Figure 2.10 Problem 2.62. 
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1.5 




Y{n) 



0.4 



-0.3 



Figure 2.13 Problem 2.65. 



2.65 Derive the transfer function H(z) for the circuit shown in Figure 2.13 
and find its unit impulse response h{n). 

2.66 Write the equations in the z domain to describe the LTI-DT system given 
in Figure 2.14 and derive the transfer function H{z) — Y^iz)/ X{z), as a 
ratio of two polynomials. 
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X{Z) ^0 




0.5 

1> 



1.5 



-0.1 1.2 0.3 

Figure 2.14 Problem 2.66. 




0.4 





0.4 0.1 
Figure 2.15 Problem 2.67 




0.02 0.4 
Figure 2.16 Problem 2.68. 



^Y(n) 



2.67 Repeat Problem 2.66 for the circuit given in Figure 2.15. 

2.68 Find the unit pulse response of the LTI-DT system shown in Figure 2.16. 

2.69 Find the unit pulse response h(n) of the discrete-time system shown in 
Figure 2.17. 
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Figure 2.17 Problem 2.69. 




2.70 Find the transfer function H(z) of the discrete-time system given in 
Figure 2.18. 

2.71 Derive the transfer function of the digital filter shown in Figure 2.19 and 
find the samples h(0),h(l), and h(2). 

2.72 Derive the transfer function H (z) for the digital filter shown in Figure 2.20 
and find its unit impulse response h(n). 

2.73 Find the unit sample response h(n) of the discrete-time system shown in 
Figure 2.21. 
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Figure 2.21 Problem 2.73 
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1.5 



X(z) 



0.75 



-2.0 



-1.0 



-<^ 

1.5 



Y(z) 



Figure 2.22 Problem 2.74. 



2.74 Derive the transfer function H(z) = Yiz)/X(z) for the LTI-DT system 
shown in Figure 2.22. 

2.75 A moving-average filter is defined by y{n) — l/N yin — k). Find 
the transfer function of the filter when N — 10. 

2.76 In the partial fraction expansion of H{z) — N{z)/Ylk=i(z ~ ^k) — 
11k=i ^k/(z — Zk), which has simple poles at z — Zk, show that the 
residues Rk can be found from the formula Rk — N(zk)/D (zk), where 
D'{z)^dDiz)/dz. 

2.77 The transfer function H(z) is expanded into its partial fraction form as 
shown below: 



(z - 0.1)(z - 0.2)(1 - 0.3z-i)(l - 0.5z-i) 

Kiz K2Z R3 R4 

(z-0.1) (z-0.2) (1-0.3Z-1) (l-O.Sz-i) 

Find the values of Ki, K2, R3, R4. 

2.78 (a) If the transfer function 77 (z~') is expanded into the form as shown 
below, find the values of Ri and R2: 
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_1 _ 1 

-* ~ (1 -0.5z-i)(l -O.U-1) 
Ri ^ R2 



(1-0.5Z-1) (1-O.lz-i) 
(b) If we are given a general transfer function of the form 



n=l 



what is the general method for finding the residues R„1 What is the 
unit impulse response h{n) of this system? 

2.79 (a) In the expression given below, find the values of Ki and K2 and find 
hin): 

_i _ I _ ^1 



(z-i - 0.5)(z-i - 0.1) (z-i - 0.5) (z-i - 0.1) 
(b) If we are given a transfer function of the form 



ntib-'-".) tr<2"'-''"> 

what is the general expression for finding K„? 

2.80 Given the three difference equations describing an LTI discrete-time sys- 
tem, find Y2(z) 

yt(n) = O.lx(n) + 0.2yi(n - 1) + O.SjzCn - 2) 
y2{n) = 0.2yiin)+0Ay3in) 
)'3(n) = yiin-l) + y^in - I) 
and x{n) = S{n). 

2.81 Derive the linear difference equation for the input-output relationship 
for the discrete-time system described by its transfer function 



z2 + 0.5z + 0.4 



2.82 Derive the linear difference equation for the input-output relationship 
for the system with its transfer function H{z) 



z3 + 0.2z2 - 0.4z + 0.05 
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2.83 Given the transfer function for an LTI-DT system as 

-1 

" (1 + 0.3Z-1 + 0.02Z-2) 

find the zero state response when the input is a unit step function. What 
is the zero input response that satisfies the initial conditions y{—l) = 2 
and y{-2) = 4? 

2.84 Use the Jury-Marden test to determine whether the discrete-time system 
defined by the following transfer function is stable: 



z^ + z^ + 2z + 5 

2.85 Determine whether the polynomial D{z) = 2 + 2z~^ + l.lz~^ + 
0.6z~^ + O.lz^"* has all four zeros inside the unit circle \z\ = 1, using 
the Jury-Marden test. 

2.86 Determine whether all the zeros of the polynomial 

Qiz) = 2 + 5z + Sz'^ + 7z^ + 2z^ 

are inside the unit circle \z\ = 1, using the Jury-Marden test. 

2.87 Determine whether the three zeros of the polynomial 

P(z) = z^ + 2z^ + 4z + 6 

are inside the unit circle |z| — 1, using the Jury-Marden test. 

2.88 Apply the Jury-Marden test to determine whether the polynomial has its 
zeros inside the unit circle in the z plane: 

Riz) = I - l.5z-^ - 0.5z-^ + z-\ 



MATLAB Problems 

2.89 Find the roots of the following two polynomials: 

Niiz) = 1 - 0Jz~^+)0.n25z'^ + 0.1745z-^ - 0M25z''^ 

Diiz) = 1 + 0.8z-i0.8775z"2 + 0.4333z"^ - OASOSz'"^ - 0.6639z"^ 

2.90 Plot the poles and zeros of the transfer function Hi{z) = Niiz)/ Di{z), 
where A^i (z) and Di (Z) are the polynomials given above. 
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2.91 Find the polynomials that have the zeros given below and also the product 
of the two polynomials N2iz)D2{z): 

Zeros of A^zCz) : -0.2 0.3 + jO.4 0.3 - jO.4 0.5 
Zeros of D2iz) : 0.4 0.4 0.2 + yO.2 0.0 - ^0.2 

2.92 Plot the poles and zeros of H2{z) — N2{z)/D2{z) in the z plane. 

2.93 Find the values of Ri , R2, and R^ in the expansion of the transfer function 
G{z), using the MATLAB function residuez: 

(1 + 0.6z) Riz , R2Z , /?3Z 



(z-0.8)(z + 0.5)2 (2-0.8) (z + 0.5)2 (^ + 0.5) 

2.94 Find the values of Ki, K2, K^, K4, in the expansion of the following 
transfer functions, using the MATLAB function residuez: 



Hiiz) = 



(:. - 0.3) 



(z-0.2)3(z + 0.4)(z + 0.5) 



Kn ^ K2Z ^ K3Z ^ Kjz ^ Ksz 



(2-0.2)3 (2-0.2)2 (2-0.2) (z + 0.4) (z + 0.5) 



H2{Z) = 



(Z + 0.5)2(2 + 0.1)2(2 -0.2) 

Kiz ^ K2Z ^ K3Z ^ K4Z ^ Ksz 



(z + 0.5)2 (2 + 0.5) (z + 0.1)2 (2 + 0.1) (z-0.2) 

2.95 Plot the magnitude, phase, and group delay of the transfer function 
Hiiz~^) given below: 



Hiiz-') = 



0.20 - 0.45z- 



1 - 1.3z-i +0.75Z-2 



2.1 + 1.45Z"' 1.8-0.60Z-' 



1 - l.OVz-i + 0.30Z-2 1 - z-i + 0.25Z-2 

2.96 Given H2iz) = (1 - z"')/(l - 0.9z~^), plot the magnitude of H^iz) = 
H2izej^-^)H2ize-j^-^) and the magnitude of H4iz) = H2izej^-^) + 
H2{ze-j^% 

2.97 Find the partial fraction expansion of the following two transfer functions 
and evaluate their unit pulse response for 0 < n < 10: 



H2iz) = 



(z - 0.8) (z - +0.6) 

(z - 0.6) 
(z + 0.6)(z2 + 0.8z + 0.9) 
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2.98 Repeat Problem 2.97 with Hiiz) as follows: 

(z - 0.5) 



(z + 0.4)(z + 0.2)2 



2.99 Find the output y\(n), y2(n), and y3(n) for 0 < « < 15 of the LTI-DT 

systems defined by the preceding transfer functions H\{z), H2{z), and 

H^{z), respectively, assuming that they are excited by an input sequence 

jc(w) = {0.5 0.2 -0.3 0.1}. 
t 

Write your code using the MATLAB function filter, and submit it with 
the computer output. 

2.100 An LTI-DT system is described by the following difference equation 

y{n) + 3y{n - 1) + 2y{n -2) + y{n - 3) = x(n) + Zxin - 2) 

where ^(-l) = 1, y{-2) = 2, yi-3) = 1, and x(n) = (0.5)"u{n). Find 
the total response y{n) for 0 < « < 20 and plot yin). 

2.101 Find the pulse responses xi(n) of Xi(z), hjin) of Hiiz), and y^in) of 
Y2,{z) = Xi{z)H2iz). Convolve the first 9 samples of xi(n) with the 9 
samples of ftiC") and compare the result with the first 9 samples of y^in): 

Xiiz) = 
Hiiz) = 



(z + 0.2)(z + 0.5) 
(z + 0.2) 
z(z + 0.1) 
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CHAPTER 3 



Frequency-Domain Analysis 



3.1 INTRODUCTION 

In the previous chapter, we derived the definition for the z transform of a discrete- 
time signal by impulse-sampling a continuous-time signal Xa{t) with a sampling 
period T and using the transformation z = e'^. The signal Xa{t) has another 
equivalent representation in the form of its Fourier transform X{jco). It contains 
the same amount of information as Xa (f ) because we can obtain Xa (t) from X{jo)) 
as the inverse Fourier transform of X(jcL)). When the signal Xa(t) is sampled 
with a sampling period T, to generate the discrete-time signal represented by 
J2kLoXaikT)SinT — kT), the following questions need to be answered: 

Is there an equivalent representation for the discrete-time signal in the fre- 
quency domain? 

Does it contain the same amount of information as that found in Xa{t)7 If so, 
how do we reconstruct Xa{t) from its sample values XainT)? 

Does the Fourier transform represent the frequency response of the system 
when the unit impulse response h{t) of the continuous-time system is sam- 
pled? Can we choose any value for the sampling period, or is there a limit 
that is determined by the input signal or any other considerations? 

We address these questions in this chapter, arrive at the definition for the discrete- 
time Fourier transform (DTFT) of the discrete-time system, and describe its prop- 
erties and applications. In the second half of the chapter, we discuss another trans- 
form known as the discrete-time Fourier series (DTFS) for periodic, discrete-time 
signals. There is a third transform called discrete Fourier transform (DFT), which 
is simply a part of the DTFS, and we discuss its properties as well as its applica- 
tions in signal processing. The use of MATLAB to solve many of the problems 
or to implement the algorithms will be discussed at the end of the chapter. 
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3.2 THEORY OF SAMPLING 

Let us first choose a continuous-time (analog) function Xait) that can be repre- 
sented by its Fourier transform Za(7^2)' 

/oo 
Xa(t)e-J'''dt (3.1) 
-00 

whereas the inverse Fourier transform of Xa{j^) is given by^ 

1 

Xait) = — / Xaij^)eJ'"dQ (3.2) 

Now we generate a discrete-time sequence x{nT) by sampling .j;a(f) with a 
sampling period T. So we have x(nT) = Xa{t)\f^„-i- , and substituting t = nT in 
(3.2), we can write 

.^«(nr) = xinT) = — / Xa(jQ)e^''"''dQ (3.3) 

The z transform of this discrete-time sequence is^ 

oo 

X{z) = J2 ^(nT)z-" (3.4) 
and evaluating it on the unit circle in the z plane; thus, when z = e^"^, we get 

00 

Z(e^'"^)= J2 xinT)e-j''"'^ (3.5) 

n=—oo 

Next we consider h{nT) as the unit impulse response of a linear, time- 
invariant, discrete-time system and the input x(nT) to the system as e-'"'"^. Then 
the output yinT) is obtained by convolution as follows: 

oo 

yinT)= J2 ej'^^"'^-''^^hikT) 

k=—oo 

OO oo 

^^j^nT J2 e-j'"''^hikT) = ej'""^ J2 HkT)e-j'"''^ (3.6) 



k=—oo k=—co 



The material in this section is adapted from a section with the same heading, in the author's boolc 
Magnitude and Delay Approximation of 1-D and 2-D Digital Filters [1], with permission from the 
publisher, Springer- Verlag. 

^We have chosen (measured in radians per second) to denote the frequency variable of an analog 
funclion in this section and will choose the same symbol to represent the frequency to represent the 
frequency response of a lowpass, normalized, prototype analog filter in Chapter 5. 
-^Here we have used the bilateral z transform of the DT sequence, since wc have assumed that it 
is defined for — oo < n < oo in general. But the theory of bilateral z transform is not discussed in 
this book. 



114 



FREQUENCY-DOMAIN ANALYSIS 



Note that the signal e-'"'"^ is assumed to have values for — oo < n < oo in gen- 
eral, whereas hikT) is a causal sequence: h{kT) = 0 for — oo < k <0. Hence the 
summation J2T=-oo HkT)e-^'"'''^ in (3.6) can be replaced by J^^o HkT)e-^'"'''^ . 
It is denoted as H{e^'^^) and is a complex- valued function of u), having a magni- 
tude response | // (e-''"^ ) | and phase response 0{e^'"^). Thus we have the following 
result 

yinT) = e^""^ | //(e>^) | g^'^C^'"^) (3.7) 

which shows that when the input is a complex exponential function e^®"^, 
the magnitude of the output y{nT) is |//(e-''"^)| and the phase of the output 
y(nT) is (conT + 9). If we choose a sinusoidal input x(nT) — Re(Ae'""^) — 
Aco&{conT), then the output y{nT) is also a sinusoidal function given by 
y{nT) = A |//(e-''*'^)| cos(ft>n? -|- 9). Therefore we multiply the amplitude of the 
sinusoidal input by |/f(e '"^)| and increase the phase by 9(e ''"^) to get the ampli- 
tude and phase of the sinusoidal output. For the reason stated above, H{e^'^^) 
is called the frequency response of the discrete-time system. We use a similar 
expression YlT=-oo^^^'^^^~''"'^^ — ^(s'"^) for the frequency response of any 
input signal x(kT) and call it the discrete-time Fourier transform (DTFT) of 
x{kT). 

To find a relationship between the Fourier transform Xa (j^) of the continuous- 
time function Xait) and the Fourier transform Z(e^"^) of the discrete-time 
sequence, we start with the observation that the DTFT X(e-''"^) is a periodic func- 
tion of CO with a period = 2jt/T, namely, x{e''"'^+''''"^'^) = x(e''"'^+j'^'') = 
X{e^"^), where r is any integer. It can therefore be expressed in a Fourier series 
form 

oo 

Xiej'"^)= J2 Cne-j'""'^ (3.8) 

n=— 00 

where the coefficients C„ are given by 

Cn = ^ XieJ'''')eJ''''dco (3.9) 

J-(7t/T) 

By comparing (3.5) with (3.8), we conclude that x(nT) are the Fourier series 
coefficients of the periodic function X{e^'^^), and these coefficients are evaluated 
from 

C„ = x{nT) = ^ I ' Xie}'^'^)e^'^"'^dco (3.10) 

In J-(n:/T) 

Therefore 

oo 

Z(e^'"^)= J2 xinT)e^j'""'^ (3.11) 

«=— 00 
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Let US express (3.3), which involves integration from Q = — oo to f2 = oo as 
the sum of integrals over successive intervals each equal to one period 
lir/T = cOs'. 



, (2r+l)£ 



1 r f 

xinT) = —T / ,^ XaU^)e'''"'' dQ (3.12) 
2;t J ur-m 



However, each term in this summation can be reduced to an integral over the 
range —(n/T) to ;r/r by a change of variable from S2 to S2 + 2nr/T, to get 



T ^ 1 f'/T / 27rr\ ,. 

xinT)^—J2 ^ Xaij^ + j—)e' 



^nTJlnrn^^ (3.13) 



Note that e'^jr™ _ ^ for all integer values of r and n. By changing the order of 
summation and integration, this equation can be reduced to 



T r'^ \\ ^ ( 2jTr\ 



(3.14) 



Without loss of generality, we change the frequency variable S2 to a>, thereby 
getting 



T r^lT [1 ~ / 27rr\' 



(3.15) 



Comparing (3.10) with (3.15), we get the desired relationship: 



1 ^ / 27rr\' 

- 2^ Xa[i(a + j—\ 

r— — rv-i ^ ' 



(3.16) 



This shows that the discrete-time Fourier transform (DTFT) of the sequence 

x(nT) generated by sampling the continuous-time signal Xa(t) with a sampling 
period T is obtained by a periodic duplication of the Fourier transform X^U^^) 
of Xait) with a period 2jt/T = cos and scaled by T. To illustrate this result, 
a typical analog signal Xa(t) and the magnitude of its Fourier transform are 
sketched in Figure 3.1. In Figure 3.2a the discrete-time sequence generated by 
sampling Xa{t) is shown, and in Figure 3.2b, the magnitude of a few terms of 
(3.16) as well as the magnitude |X(e^'"^)| are shown. 

Ideally the Fourier transform of Xa (t) approaches zero only as the frequency 
approaches oo. Hence it is seen that, in general, when Xa{j(o)IT is duplicated 
and added as shown in Figure 3.2b, there is an overlap of the frequency responses 
at all frequencies. The frequency responses of the individual terms in (3.16) add 
up, giving the actual response as shown by the curve for |Z(e-''")|. [We have 
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Figure 3.2 The discrete-time signal Xa{nT) obtained from tiie analog signal Xa(t) and 
the discrete-time Fourier transform H{e''"). 
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disregarded the effect of phase in adding the duphcates of Xijco).] Because of 
this overlapping effect, more commonly known as "aliasing," there is no way of 
retrieving Xijco) from X{e^") by any linear operation; in other words, we have 
lost the information contained in the analog function Xa(t) when we sample it. 
Aliasing of the Fourier transform can be avoided if and only if (1) the function 
Xait) is assumed to be bandlimited — that is, if it is a function such that its 
Fourier transform Xaijco) = 0 for \cl>\ > aoh; and (2) the sampling period T is 
chosen such that aos — 2n/T > Icub. When the analog signal Xb{t) is bandlimited 
as shown in Figure 3.3b and is sampled at a frequency cdj > Icob, the resulting 
discrete-time signal xi,{nT) and its Fourier transform Z(e'™) are as shown in 
Figure 3.4a,b, respectively. 

If this bandlimited signal Xh(nT) is passed thi'ough an ideal lowpass filter 
with a bandwidth of cl>s/2, the output will be a signal with a Fourier transform 
equal to X{e^'^^)Hip{ico) — Xi,(jco)/T. The unit impulse response of the ideal 
lowpass filter with a bandwidth cot, obtained as the inverse Fourier transform of 
Hipijo)) is given by 

1 

hip(t) = — j H,pijco)e'''"dco 

= — / Te''-"dm (3.17) 

2 

sin 1 — 1 sm(-l 

= / A = (3.18) 
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Figure 3.3 A bandlimited analog signal and the magnitude of its Fourier transform. 
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XbinT) 



0 



n 



Ideal analog lowpass filter 






u>b —L 




Figure 3.4 The discrete-time signal obtained from tlie bandlimited signal and the mag- 
nitude of its Fourier transform. 

The output signal will be the result of convolving the discrete input sequence 
Xh{nT) with the unit impulse response hip{t) of the ideal analog lowpass fil- 
ter. But we have not defined the convolution between a continuous-time signal 
and samples of discrete-time sequence. Actually it is the superposition of the 
responses due to the delayed impulse responses hip{t — nT), weighted by the 
samples Xb(nT), which gives the output Xb{t). Using this argument, Shannon [2] 
derived the formula for reconstructing the continuous-time function Xb(t), from 
only the samples x(n) — xi,{nT) — under the condition that Xbit) be bandlimited 
up to a maximum frequency cob and be sampled with a period T < n/cDb. This 
formula (3.19) is commonly called the reconstruction formula, and the statement 
that the function Xbit) can be reconstructed from its samples XbinT) under the 
abovementioned conditions is known as Shannon's sampling theorem: 



The reconstruction process is indicated in Figure 3.5a. An explanation of the 
reconstruction is also given in Figure 3.5b, where it is seen that the delayed 
impulse response sin [^(f — nT)\ / \^(t — nT)\ has a value of XhinT) at t = nT 
and contributes zero value at all other sampling instants t ^ nT so that the 
reconstructed analog signal interpolates exactly between these sample values of 
the discrete samples. 




oo 



sm 



(3.19) 
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Ideal Lowpass analog filter ^^(f) 



x,(t) = x^inTTh^t) 



Xi,(jco) = Xi,(e''"T)H^{jco) 



x(0) 



Reconstructed signal 
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Figure 3.5 Reconstruction of the bandlimited signal from its samples, using an ideal 
lowpass analog filter. 

This revolutionary theorem implies that the samples Xh(nT) contain all the 
information that is contained in the original analog signal Xh{t), if it is bandlim- 
ited and if it has been sampled with a period T < n/coh- It lays the necessary 
foundation for all the research and developments in digital signal processing 
that is instrumental in the extraordinary progress in the information technology 
that we are witnessing."* In practice, any given signal can be rendered almost 
bandlimited by passing it through an analog lowpass filter of fairly high order. 
Indeed, it is common practice to pass an analog signal through an analog lowpass 
filter before it is sampled. Such filters used to precondition the analog signals 
are called as antialiasing filters. As an example, it is known that the maximum 
frequency contained in human speech is about 3400 Hz, and hence the sampling 
frequency is chosen as 8 kHz. Before the human speech is sampled and input to 
telephone circuits, it is passed through a filter that provides an attenuation of at 
least 30 dB at 4000 Hz. It is obvious that if there is a frequency above 4000 Hz 
in the speech signal, for example, at 4100 Hz, when it is sampled at 4000 Hz, 
due to aliasing of the spectrum of the sampled signal, there will be a frequency 
at 4100 Hz as well as 3900 Hz. Because of this phenomenon, we can say that 
the frequency of 4100 Hz is folded into 3900 Hz, and 4000 Hz is hence called 
the "folding frequency." In general, half the sampling frequency is known as the 
folding frequency (expressed in radians per second or in hertz). 

'^This author feels that Shannon deserved an award (such as the Nobel prize) for his seminal contri- 
butions to sampling theory and information theory. 
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There is some ambiguity in the published literature regarding the definition of 
what is called the Nyquist frequency. Most of the books define half the sampling 
frequency as the Nyquist frequency and 2//, as the Nyquist rate, which is the 
minimum sampling rate required to avoid aliasing. Because of this definition for 
the Nyquist rate, some authors erroneously define fb as the Nyquist frequency. 
In our example, when the signal is sampled at 8 kHz, we have 4 kHz as the 
Nyquist frequency (or the folding frequency) and 6.8 kHz as the Nyquist rate. 
If we sample the analog signal at 20 kHz, the Nyquist frequency is 10 kHz, but 
the Nyquist rate is still 6.8 kHz. We will define half the sampling frequency as 
the Nyquist frequency throughout this book. Some authors define the Nyquist 
frequency as the bandwidth of the corresponding analog signal, whereas some 
authors define 2/^ as the bandwidth. 

3.2.1 Sampling of Bandpass Signals 

Suppose that we have an analog signal that is a bandpass signal (i.e., it has a 
Fourier transform that is zero outside the frequency range a)\ <a) < 0)2); the 
bandwidth of this signal is B = (x)2 — (Oi, and the maximum frequency of this 
signal is (02. So it is bandlimited, and according to Shannon's sampUng theorem, 
one might consider a sampling frequency greater than 2(02\ however, it is not 
necessary to choose a sampling frequency > 2co2 in order to ensure that we 
can reconstruct this signal from its sampled values. It has been shown [3] that 
when 0)2 is a multiple of B, we can recover the analog bandpass signal from its 
samples obtained with only a sampling frequency cOs > 25. For example, when 
the bandpass signal has a Fourier transform between o}\ = 4500 and (02 = 5000, 
we don't have to choose a)j > 10,000. We can choose cOg > 1000, since (02 = 
lOB in this example. 

Example 3. 1 

Consider a continuous-time signal Xa(t) = e~^'^*u{t) that has the Fourier 
tr ansform X{ja> ) = l/{jo} + 0.2). The magnitude \X{ito)\ = 1 1/(70; -H 0.2) | = 
^l/{aP- + 0.04), and when we choose a frequency of 2007r, we see that the 
magnitude is approximately 0.4(10"^). Although the function Xa{t) = e~^-^'u{t) 
is not bandlimited, we can assume that it is almost bandlimited with bandwidth 
of 200;r and choose a sampling frequency of 4007r rad/s or 200 Hz. So the sam- 
pling period r = = 0.005 second and tOg =2n/T = AQOn rad/s. To verify 
that (3.11) and (3.16) both give the same result, let us evaluate the DTFT at 
CO = 0.5 rad/s. According to (3.11), the DTFT of xinT) is 



00 



00 




= Z(e>^) = 



1 



1 _ g-0.001g-;(0.005(u) 



(3.20) 
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and its magnitude ai co — 0.5 is 



1 



1 



= 371.5765 



According to (3.16), the DTFT for this example becomes 

1 A 1 



0.005 



E 



0.2 + j(a) + k4007T) 



(3.21) 



and at ct) = 0.5, we can neglect the duplicates at jkAOOjt and give the magnitude 
of the frequency response as 



1 



0.005 



1 



0.2 + yo.5 



= 371.3907 



The two magnitudes at co = 0.5 are nearly equal; the small difference is 
attributable to the slight aliasing in the frequency response. See Figure 3.6, which 
illustrates the equivalence of the two equations. But (3.16) is not useful when 
a sequence of arbitrary values (finite or infinite in length) is given because it 
is difficult to guess the continuous-time signal of which they are the sampled 
values; even if we do know the continuous-time signal, the choice of a sampling 
frequency to avoid aliasing may not be practical, for example, when the signal is 
a highpass signal. Hence we refer to (3.11) whenever we use the acronym DTFT 
in our discussion. 



\X(el")\ 
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Figure 3.6 Equivalence of the two definitions for the Fourier transform of a discrete-time 
signal. 
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3.3 DTFTANDIDTFT 



The expressions for the DTFT X{e^^) and the IDTFT x{n) are 



oo 



') 




-jam 



(3.22) 



n=0 



1 r 



(3.23) 



The DTFT and its inverse (IDTFT) are extensively used for the analysis and 
design of discrete-time systems and in apphcations of digital signal processing 
such as speech processing, speech synthesis, and image processing. Remember 
that the terms frequency response of a discrete-time signal and the discrete-time 
Fourier transform (DTFT) are synonymous and will be used interchangeably. 
This is also known as the frequency spectrum; its magnitude response and 
phase response are generally known as the magnitude spectrum and phase spec- 
trum, respectively. We will also use the terms discrete-time signal, discrete-time 
sequence, discrete-time function, and discrete-time series synonymously. 

We will represent the frequency response of the digital filter either by 
H(ej'^^) or more often by //(e-'™) for convenience. Whenever it is expressed 
as H{e^^) — which is very common practice in the published literature — the 
frequency variable w is to be understood as the normalized frequency aT = 
co/fs. We may also represent the normalized frequency coT by 9 (radians). In 
Figure 3.7a, we have shown the magnitude response of an ideal lowpass filter, 
demonstrating that it transmits all frequencies from 0 to coc and rejects frequencies 
higher than a>c. The frequency response //(e-'™) is periodic, and its magnitude is 
an even function. In Figure 3.7b suppose we have shown the magnitude response 
of the lowpass filter only over the frequency range [0 Jt]. We draw its magni- 
tude for negative values of co since it is an even function and extend it by repeated 
duplication with a period of 2n, thereby obtaining the magnitude response for all 
values of co over the range (—00,00). Therefore, if the frequency specifications 
are given over the range [0 ;r], we know the specifications for all values of the 
normalized frequency to, and the specifications for digital filters are commonly 
given for only this range of frequencies. Note that we have plotted the magni- 
tude response as a function of the normalized frequency co. Therefore the range 
[0 7t] corresponds to the actual frequency range [0 cOs/2] and the normalized 
frequency n corresponds to the Nyquist frequency (and 2n corresponds to the 
sampling frequency). 

Sometimes the frequency co is even normalized by nfs so that the Nyquist 
frequency has a value of 1, for example, in MATLAB functions. In Figures 3.7c,d, 
we have shown the magnitude response of an ideal highpass filter. In Figure 3.8 
we show the magnitude responses of an ideal bandpass and bandstop filter. 

It is convenient to do the analysis and design of discrete-time systems on 
the basis of the normalized frequency. When the frequency response of a fil- 
ter, for example, shows a magnitude of 0.5 (i.e., —6 dB) at the normalized 
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Figure 3.7 Magnitude responses of ideal lowpass and higlipass filters. 

frequency 0.37T, the actual frequency can be easily computed as 30% of the 
Nyquist frequency, and when the sampling period T or the sampling frequency 
(or fs — l/T) is given, we know that OJtt represents (0.3)(<Wi./2) rad/s or 
(0.3) (/s/2) Hz. By looking at the plot, one should therefore be able to determine 
what frequency scaling has been chosen for the plot. And when the actual sam- 
pling period is known, we know how to restore the scaling and find the value 
of the actual frequency in radians per second or in hertz. So we will choose the 
normalized frequency in the following sections, without ambiguity. 

The magnitude response of the ideal filters shown in Figures 3.7 and 3.8 cannot 
be realized by any transfer function of a digital filter. The term "designing a digital 
filter" has different meanings depending on the context. One meaning is to find a 
transfer function H{z) such that its magnitude |//(e^"')| approximates the ideal 
magnitude response as closely as possible. Different approximation criteria have 
been proposed to define how closely the magnitude |i/(e'")| approximates the 
ideal magnitude. In Figure 3.9a, we show the approximation of the ideal lowpass 
filter meeting the elliptic function criteria. It shows an error in the passband as 
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Figure 3.8 Magnitude responses of ideal bandpass and bandstop filters. 
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Figure 3.9 Approximation of ideal lowpass and highpass filter magnitude response. 
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Figure 3.10 Approximation of ideal bandpass and bandstop digital filters. 



well as in the stopband, which is equiripple in nature, whereas in Figure 3.9b, 
the magnitude of a highpass filter is approximated by a Butterworth type of 
approximation, which shows that the magnitude in the passband is "nearly flat" 
and decreases monotonically as the frequency decreases from the passband. 

Figure 3.10a illustrates a Chebyshev type I approximation of an ideal band- 
pass filter, which has an equiripple error in the passband and a monotonically 
decreasing response in the stopband, whereas in Figure 3.10b, we have shown a 
Chebyshev type II approximation of an ideal bandstop filter; thus, the error in 
the stopband is equiripple in nature and is monotonic in the passband. The exact 
definition of these criteria and the design of filters meeting these criteria will be 
discussed in the next two chapters. 



3.3.1 Time-Domain Analysis of Noncausal Inputs 

Let the DTFT of the input signal x{n) and the unit impulse response h(n) of 
a discrete-time system be X(e^") and H{e''^), respectively. The output y{n) 
is obtained by the convolution sum * h(n) — y{n) — h{k)x(n — k), 

which shows that the convolution sum is applicable even when the input signal 
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is defined for— oo < n <0or— oo < n <oo. In tiiis case, the unilateral z trans- 
form of x{n) cannot be used. Therefore we cannot find the output y(n) as the 
inverse z transform of X(z)H(z). However, we can find the DTFT of the input 
sequence even when it is defined for — oo < n < oo, and then multiply it by the 
DTFT of h{n) to get the DTFT of the output as F(e-''") = Z(e-'<")7/(e-''"). Its 
IDTFT yields the output y(n). This is one advantage of using the discrete-time 
Fourier transform theory. So for time-domain analysis, we see that the DTFT- 
IDTFT pair offers an advantage over the z-transform method, when the input 
signal is defined for — oo < n < 0 or — oo < « < oo. An example is given later 
to illustrate this advantage over the z-transform theory in such cases. 

The relationship Y{e-''") = X{e->'^)H{e^'") offers a greater advantage as it is 
the basis for the design of all digital filters. When we want to eliminate certain 
frequencies or a range of frequencies in the input signal, we design a filter such 
that the magnitude of H{e''") is very small at these frequencies or over the 
range of frequencies that would therefore form the stopband. The magnitude of 
the frequency response H(e-''") at all other frequencies is maintained at a high 
level, and these frequencies constitute the passband. The magnitude and phase 
responses of the filter are chosen so that the magnitude and phase responses of 
the output of the filter will have an improved quality of information. We will 
discuss the design of digital filters in great detail in Chapters 4 and 5. We give 
only a simple example of its appUcation in the next section. 

Example 3.2 

Suppose that the input signal has a lowpass magnitude response with a bandwidth 
of O.Ttt as shown in Figure 3.11 and we want to filter out all frequencies outside 
the range between coi = O.Stt and (02 = OAn. Note that the sampling frequency 
of both signals is set at 2jr. If we pass the input signal through a bandpass 
filter with a passband between coi = OJn and C02 = OAn, then the frequency 
response of the output is given by a bandpass response with a passband between 
a>i = O.Stt and 0)2 = OAir, with all the other frequencies having been filtered 
out. It is interesting to observe that the maximum frequency in the output is 
OAn; therefore, we can reconstruct 3^(0 from the samples y(n) and then sample 
at a lower sampling frequency of 0.8:r, instead of the original frequency of In. 

If the sampling frequency in this example is 10,000 Hz, then the Nyquist fre- 
quency is 5000 Hz, and therefore the input signal has a bandwidth of 3500 Hz, 
corresponding to the normalized bandwidth of O.Ttt, whereas the bandpass filter 
has a passband between 1500 and 2000 Hz. The output of the bandpass filter has 
a passband between 1500 and 2000 Hz. Since the maximum frequency in the 
output signal is 2000 Hz, one might think of reconstructing the continuous-time 
signal using a sampling frequency of 4000 Hz. But this is a bandpass signal 
with a bandwidth of 500 Hz, and 2000 Hz is 8 times the bandwidth; according 
to the sampling theorem for bandpass signals, we can reconstruct the output sig- 
nal ^(f) using a sampling frequency of twice the bandwidth, namely, 1000 Hz 
instead of 4000 Hz. The theory and the procedure for reconstructing the analog 
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Figure 3.11 A lowpass signal processed by a bandpass filter. 

bandpass signal from its samples is beyond the scope of this book and will not 
be treated further. 



3.3.2 Time-Shifting Property 

If x(n) has a DTFT Z(e^"), then x{n 



k) has a DTFT equal to e'^'^'^Xie^'^), 



where k is an integer. This is known as the time- shifting property and it 
is easily proved as follows: DTFT of x(n — fc) = x(« — = 

e-i'"'' El^-oo^C")^"^"" = e-^"*^Z(e^"'). So we denote this property by 



x(n-k) ^ e-^'^'^Xiej") 



3.3.3 Frequency-Shifting Property 

If x(n) <^ Z(e'™), then 

This is known as the frequency-shifting property, and it is easily proved as 
follows: 

00 00 
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3.3.4 Time Reversal Property 

Let us consider x(n) = a"uin). Its DTFT XieJ'") = J2T=o a" e~ Next, to find 
the DTFT of x{—n), if we replace n by —n, we would write the DTFT of xi—n) 
as ^^^a^"e^^" (but that is wrong), as illustrated by the following example: 

oo 

XieJ'") = J2 a"e-j''" = 1 + ae'j'' + a^e'j^ + a^e'^^'" + ■■■ 

n=0 

But the correct expression for the DTFT of x(—n) is of the form 1 + ae-'"' + 
a^eJ^ + a^eJ^'" + ■■■. 

So the compact form for this series is Yln=-oo a~"e~-''"". With this clarifica- 
tion, we now prove the property that if xin) 4^ X{e^'") then 

x{-n) ^ Xie-}") (3.24) 

Proof: DTFT ofx(-n) = E)S=-oo (-«)«"■""". We substitute (-n) = m, and 

we get E^-cc-^(-«)^~''"" = E~=_co^('«)^'"'" = E~=-co^('«)«~''^"""" = 
Xie-j""). 

Example 3.3 

Consider x(n) = S(n). Then, from the definition for DTFT, we see that S(n) 
Xie '"') = 1 for all co. 

From the time-shifting property, we get 

5 (n -A:) ^ (3.25) 

The Fourier transform e~-'<"* has a magnitude of one at all frequencies but a 
linear phase as a function of co that yields a constant group delay of k samples. If 
we extend this result by considering an infinite sequence of unit impulses, which 
can be represented by E^-oo '5(" - its DTFT would yield YaL_^ e"-'"*^. 
But this does not converge to any form of expression. Hence we resort to a 
different approach, as described below, and derive the result (3.28). 

Example 3.4 

We consider x(n) = S(n + k) + S(n - k).lts DTFT is given by X(e''") = e^'^^ + 
g-jaik _ 2cos(a>k). In this example, note that the DTFT is a function of the 
continuous variable co whereas k i& a fixed number. It is a periodic function of 
CO with a period of 2jt, because 2cos((ft) -I- 2r7t)k) = 2cos(cok), where r is an 
integer. In other words, the inverse DTFT of X(e''") = 2cos(cok) is a pair of 
impulse functions at n = k and n = —k, and this is given by 



cosicok) 4^ ^[Sin + k) + Sin - k)] 



(3.26) 
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Example 3.5 



Now we consider the infinite sequence of x(n) — I for all n. We represent it in 
the form xin) = X!fcl-oo ^in — k). We prove below that its DTFT is given as 
Itt J2'^-oo — 27rfe), which is a periodic train of impulses in the frequency 
domain, with a strength equal to In and a period equal to In (which is the 
normalized sampling frequency). We prove this result given by (3.27), by showing 
that the inverse DTFT of In Y^^=-oo — 2;r^) is equal to one for all n. 



In ^ 5 (ft) - Ink) ^ 1 (for all n) 



(3.27) 



Proof: The inverse DTFT of In Y^=-oa ^i'^ — '^n:k) is evaluated as 



1 r 

=/■ 

J— J 



In ^ S(co-2nk) 

k=—oo 

00 

J2 S{co-2nk) 



. k=—oo 

From the sifting property we get 



J2 S(co-2nk) 



. k=—oo 



J2 S(co-2nk) 

=—00 

OO 

^ S(a)-2nk) 



Jlnkn 



k=—oo 



where we have used e^2;r*:n _ ^ ^^j. ^jj ^ When we integrate the sequence of 
impulses from —n to tt, we have only the impulse at ft) = 0. 
Therefore 



/" 

J— J 



-i 



k=—oo 
n 



e^"'" dco 



^ 8(0) -2nk) 

X) 

OO 

J2 S(co)ej'"" dco = 1 (for aU n) 



k=—oo 

Thus we have derived the important result 



OO OO 

J2 Sin-k)^2n 8(oj-2nk) 



(3.28) 
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To point out some duality in the results we have obtained above, let us repeat 
them: 

When x{n) = 1 at n = 0 and 0 at n 7^ 0, that is, when we have S(n), its DTFT 
= 1 for all o). 

When x(n) = 1 for all n, specifically, when we have X!^-oo^(" — k), its 
DTFT X(ej^) = In J2Z-oo ^(^^ - ^^k). 

Using the frequency- shifting property, we get the following results: 

eioH^n ^27t 8{(o - two - 2;rA;) (3.29) 

k=—oo 

From these results, we can obtain the DTFT for the following sinusoidal 
sequences: 

1 °° 
cos(cwo«) = + e'-"^"] ^Tt Y^8{o)-(0o- Ink) + Sico + coo- Ink) 

k=—oo 

^ 00 

sin(a)on) = — [e-''»«"-e--''^«]4^ - V S(o) -coq- Ink) - 6{(o + m- 2nk) 
•' •' k--oo 

(3.30) 

Now compare the results in (3.28) and (3.30), which are put together in (3.31) 
and (3.32) in order to show the dualities in the properties of the two transform 
pairs. Note in particular that cosicok) is a discrete-time Fourier transform and a 
function of co, where ^ is a fixed integer, whereas cos{a>on) is a discrete-time 
sequence where coq is fixed and is a function of n: 

^[S(n + k) + S(n - k)] cos(cok) (3.31) 
cos(cwoi) -^=5^ ^ ^ S(a> — a>o — Ink) + 6{co + coq — Ink) 

k——oo 

(3.32) 

Let us show the duaUty of the other functions derived in (3.26) and (3.29) 

8{n) -^=^ 1 for all co 

whereas 

00 

x{n) = \ for all n -^=> 27r ^ 8(0) -Ink) 
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Using the time- and frequency-shifting properties on these functions, we 
derived the following Fourier transform pairs as well: 

OO 

gjcoon 27T ^ 8(0) -COO- ^Tlk) 

k=—oo 

Example 3.6 

This is another example chosen to highlight the difference between the 
expressions for the discrete-time sequence x{n) and its DTFT So if 

we are given f (e-'") = lOcosCScu) -|- 5cos(2c(j) = 5e-''^™ + 5e~-''^" + 2.5e'2™ + 
2.5e~^^'^, its IDTFT is obtained by using the result S(n — A:) 4$- e~^'^^, and we 
get fin) = 5S{n + 5) + 2.58{n + 2) + 2.5<5(n - 2) + 5S(n - 5), which is plot- 
ted in Figure 3.12a. Obviously it is a finite sequence with four impulse functions 
and therefore is not periodic. 

t " ^ T 

. - 2.5 T 



-5-4-3-2 -1 0 1 2 3 4 5 n — 

(a) 







|G(e>)| 






10 








1 1 


5- 

1 


1 


1 1 





-0.57C -0.2rt 0 0.27t 0.5ji m — »- 

(b) 

Figure 3.12 A sequence of impulses in the discrete-time domain and a sequence of 
impulses in the discrete-frequency domain. 
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If we are given a function = 10 cos(0.5;rn) + 5 cos(0.2;rn), the first thing 
we have to recognize is that it is a discrete-time function and is a periodic function 
in its variable n. So we find its DTFT, using (3.30), as 

oo oo 

G(en = 107r J2 ^(<w-0.5;r-2;rife)-M0;r ^ Sico + O.Sn - 2nk) 

k=—oo k=—oo 

oo oo 

-|-5;r ^ Sico -0.2n - Ink) + 57T ^ S(a> + 0.27t - 2nk) 

k=—oo k=—oo 

This DTFT is shown in Figure 3.12b. We notice that it represents an infinite 
number of impulses in the frequency domain that form a periodic function in the 
frequency variable co. Because it has discrete components, the impulse functions 
are also called the spectral components of gin). 

We have chosen a DTFT F(e'") and derived its IDTFT f(n), which is a 
sequence of impulse functions in the time domain as shown in Figure 3.12a; 
then we chose a discrete-time function g{n) and derived its DTFT G(e^"), 
which is a sequence of impulse functions in the frequency domain as shown 
in Figure 3.12b. 

Examples.? 

Consider the simple example of a discrete-time sinsusoidal signal x{n) = 
4cos(0.4:Tn). It is periodic when the frequency (0.4A^) is an integer or a ratio of 
integers. We choose N = 5 as the period of this function, so x{n) = x{n + 5K) = 
4cos[0.4;r(n -|- 5K)], where K is any integer. 

We rewrite x(n) = 2[e''''^^" + e-'"'*^"], and therefore its DTFT Xie^"') = 

2n E^-oo ^("^ - - ^^^) + 2^ E^-oo ^("^ + 0-47r - 2nk). It consists of 
impulse functions of magnitude equal to 2n, at cw = ±(0.4;r + 2nK) in the 
frequency domain and with a period of 27r. 

Given f(n) = 2S{n + 4) + 28(n - 4), its DTFT is F(e^^) = 4cos(4(w), and 
ifxin) = 4cos(0.47rn), its DTFT is = 2n J2T=-oo ^('w - 0-4^ - ^^rfe) + 

T,T=-oo + 0-47r - 2jTk). 

Examples 3.6 and 3.7 have been chosen in particular to distinguish the differ- 
ences between the two Fourier transform pairs. 

Example 3.8 

Let us consider the DTFT of some more sequences. For example, the DTFT of 
xi(n) = a"u{n) is derived below: 

oo 00 
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This infinite series converges to 1/(1 — ae = — a) when 

\ae-j'"\ < 1, that is, when |a I < 1. So.theDTFTof (0.4)"M(n) is 1/(1 - 0.4e--''") 
andtheDTFTof (-0.4)"M(n)is 1/(1 + 0.4e--''"). Note that both of them are causal 
sequences. 

If we are given a sequence xi^in) = a^"^, where \a\ < 1, we split the sequence 
as a causal sequence xi(n) from 0 to oo, and a noncausal sequence x^in) 
from — oo to —1. In other words, we can express xi(n) = a"u(n) and x^in) = 
a~"u(—n — 1). We derive the DTFT of xi3(n) as 

oo —1 

Xi3(e^'") = ^a"e->«+ a""e-^<""Zi(e^'") + Z3(e^'") 

n=0 n——oo 

Substituting m = — n in the second summation for X^ie^'"), we get 

00 00 

V m 



n=0 m= 1 

oo oo 



n=0 m=0 

^ - 1 + - — ^—^ for \a\ < 1 



1 - ae-J'^ 1 - aeJ" 

1 aej'" 
+ 



1 - ae-> 1 - aeJ" 



I — 2a cos C0 + 
Hence we have shown that 



for \a\ < 1 



fll"! ^ -i — for \a\ < 1 

1 —2a cos C0 + a'^ 

These results are valid when \a\ < 1. From the result a"u(n) 4> 1/(1 — ae~'"), 
by application of the time-reversal property, we also find that Xiin) = xi{—n) = 
a~"u{—n) ^ 1/(1 — ae-''") for \a\ < 1 whereas we have already determined that 
x^in) — a~"u{—n — 1) <^ ae'"/(l — ae''^). Note that x^in) is obtained from 
X4(n) by deleting the sample of X4(n) at n = 0, specifically, x^in) — 1 = x^in). 
We used this result in deriving X^ie^'^) above. The sequence xi-iin) is plotted in 
Figure 3.13, while the plots of xi(n), x^in) are shown in Figures 3.14 and 3.15, 
respectively. 
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Xi3(n) 



-8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 
Figure 3.13 The discrete-time sequence xisin). 



H 1 1 h 



Xi(n) 

1.0 



0.8 



0.64 



0.512 



0.41 



0.328 



0.262 



0.21 



,0.168 

J J 0. 134 



01 2345678n 
Figure 3.14 The discrete-time sequence xi(w). 
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0.64 



0.512 
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-7 -6 -5 -4 -3 -2 -1 0 

Figure 3.15 The discrete-time sequence xjin). 
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0.5 



0.25 



0.125 



0.0315 0-0625 T 
T T L 



-7 -6 -5-4-3-2-1 0 1 2 n 
Figure 3.16 The discrete-time sequence xs{n). 



Now let us consider the case of xsin) — a"u[—{n + 1)], where |a| > 1. A plot 
of this sequence is shown in Figure 3.16 for a = 2. Its DTFT is derived below: 



Z5(e'")= ^ Q!"M[-(n+ 1)]£?-''' 



— OO — OO / . 



By a change of variable n — —m, we get 



m=l ^ ^ m=Q ^ ^ 



= -1 + 



1 - (^■'-) 



1 



ae-J"' - 1 
So we have the transform pair 

X5(n) = Q!"M[-(n + 1)] <^ ^ 



when |q!| > 1 (3.33) 



It is important to exercise caution in determining the differences in this pair 
(3.33), which is valid for lal > 1, and the earlier pairs, which are valid for | a | < 1. 
All of them are given below (again, the differences between the different DTFT- 
IDTFT pairs and the corresponding plots should be studied carefully and clearly 
understood): 



x\(n) — a"u(n) 



1 

1 - ae-j" 



el"' - a 



when lal < 1 



(3.34) 
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X4(n) — a "u{—n) 4r- 



1 



-jco 



1 - aeJ"^ e-j"^ - a 



x^(n) = a "u(—n — 1) 4^ 
■^13(1) — xi(n) + x^(n) <^ 



1 - ae'™ 

1 -a^ 
I — 2a cos cl) + 



when < 1 (3.35) 
when < 1 (3.36) 
when |a| < 1 (3.37) 



For the sequence xsin) — a"u[—{n + 1)], note that the transform pair is given 
by (3.38), which is vahd when |a| > 1: 



xsin) = a"u[-in + 1)] 4> 



Example 3.9 



1 



ae~j" — 1 a - ei" 



when lal > 1 (3.38) 



A few examples are given below to help explain these differences. From the 
results given above, we see that 

1. If the DTFT Xi{e^'^) = 1/(1 - O.Se"^'"), its IDTFT is xi(n) = (0.8)"m(«). 

2. The IDTFT of Z3(e'") = 0.86''"/(l - O.Se^") is given by X3(m) = 
(0.8)-"[M(-n - 1)]. 

3. The IDTFT of X^ie^'^) = 1/(1 - O.Se^'") is jC4(n) = (0.8) ""«(-«). But 

4. The IDTFT of Xsie^"") = e^'^/(2 - e''") is xs{n) = (2)" u(-n - 1). 

Note the differences in the examples above, particularly the DTFT-IDTFT pair 
for xs{n). 

The magnitude and phase responses of X\{e^'^), X^ie^'^), and Xi3(e^™) are 
shown in Figures 3.17, 3.18, and 3.19, respectively. The magnitude responses of 
Xi{e^"), X4(e^"), and X^ie^'") given below appear the same except for a scale 




-10 1 2-2-10 1 

Figure 3.17 The magnitude and phase responses of xi(n). 
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-2 -1.5 -1 -0.5 0 0.5 1 1.5 
Figure 3.19 The magnitude response of xi3(n). 



factor in Xi{e'"). The phase response of Xj,{e'") exceeds that of Zi(e'™) by 
M radians as seen in Figures 3.17 and 3.18. The frequency response (DTFT) 
Xuie^") shown in Figure 3.19 is a real function and therefore has zero phase. 
We obtain 



1.0 



^[1 - 0.8 cos(ft;)]2 + [0.8 sin(w)]2 
1.0 



V[l +0.64- 1.6cos(ft;) 
Ang[Zi(e^")] = Ang[Z3(e-'"')] = - tan"' 



a sin (m) 
I — a cos(c(;) 



(3.39) 
(3.40) 
(3.41) 
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I ^3 {en I = (3.42) 
^[1 - 0.8cos(ftj)]2 + [0.8 sin(ft;)]2 



0.8 



V[l +0.64- 1.6cos(a)) 



(3.43) 



= 1 lA^'^^^n/.^ (3.44) 
1 — 1.6C0SCW + 0.64 



3.4 DTFT OF UNIT STEP SEQUENCE 

Note that a"M(n) 4^ 1/(1 - ae"-'") = e'"/(e-'™ - a) is valid only when \a\ < 1. 
When a = 1, we get the unit step sequence u(n), but the DTFT 1/(1 — e"-''") 
has an infinite number of poles at w = 0, ±k2jr, where k is an integer. In order 
to avoid these singularities in 1/(1 - e"-'") = e-'"/(e-'"' - 1), the DTFT of the 
unit step sequence u{n) is derived in a different way as described below. 
We express the unit step function as the sum of two functions 

u{n) = ui{n) + U2{n) 

where 



ui(n) = i for— oo<«<oo 



and 



M2(n) — 



5 for « > 0 
- ^ f or n < 0 



Therefore we express S(n) = U2(n) — U2(n — 1). Using S(n) 4^ 1 and U2in) — 
U2{n - 1) <^ U2{ei'-') - e-^*'f/2(e^") = i72(e^")[l - e"^'"], and equating the 
two results, we get 



Therefore 



1 = f/2(e^'")[l - e"^™] 



U2{en = — ^ 



[1 - e-^"] 



We know that the DTFT of ui{n) = it J2kL-oo - 2jrA;) = J7i(e-''"). Adding 
these two results, we have the final result 

u{n) <^ TT V Sico- Ink) H — (3.45) 

k=-oo 

This gives us the DTFT of the unit step function u{n), which is unique. 



DTFT OF UNIT STEP SEQUENCE 139 



Applying the time-shifting property, frequency- shifting property, and time 
reversal property on u(n), we can derive the DTFT of a few more discrete-time 
functions. For example 



u(n — k) e 



-jcok 



TC S(co-2nk)-\ r- 



k=—oo 



(1 - e-J'^) 

^ 1 

ej'^"uin)<>7r V 8(0) - coq - 27Tk) + ^ 

^-^ (1 — e^-" 



k=—oo 



(1 — e-;(<«-«>o)) 



COS(ctfo«)M(«) 



00 ^ 

7T V Si(o-(OQ-2nk) + T- 



k=—oo 



+ 7t ^ 8(0) + (Oo — Ink) + 



k=—oo 



(I — g-jCw-oJo)) 

1 

(1 — e-;(«+«o)) 



(3.46) 
(3.47) 



(3.48) 



It is worth comparing the DTFT of e^'^"u(n) given above with the DTFT of 
£"""«(«), where \a\ < 1: 



e-'"'u(n) ^ 



1 



1 - e-^e-}^ 



(3.49) 



3.4.1 Differentiation Property 

To prove that nx(n) ^ j[dX(ej'^)]/do), we start with X(e''^) = E^_oo 
;c(n)e"^™ and differentiate both sides to get [dX(e-'")]/da) = 
l]^_(x) ^iid multiplying both sides by j, we get 

;[<iZ(£'-'")]/<ift; = ^~_^nx(n)e"-''™. The proof is similar to that used 
in Chapter 2 to prove that the z transform of nx(n)u(n) is —z[dX(z)]/dz. 

Given x(n) = a"u(n) ^ 1/(1 - ae'-''^) = X(e^'^), we can derive the follow- 
ing, using the differentiation property: 



dX(e''^) 

j — ^ = j 

do) 



na"u(n) 4r- 



jae 



(l-ae-i'^Y 



ae 



(1 - ae-^'^)2 



(1 - ae-i'")^ 



(3.50) 



Since the DTFT of a"M(w) is 1/(1 - ae"-''"), we add this DTFT to that of na"u(n) 
and get 



(n + \)a"u(n) <^ 



1 

(1 - ae->)2 



(3.51) 
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Example 3. 10 

Consider a rectangular pulse 



Xr(n) - 



0 



\n\ < N 
\n\ > 



which is plotted in Figure 3.20. It is also known as a rectangular window (of 
length 2N + 1) and will be used in Chapter 5 when we discuss the design of 
FIR filters. Its DTFT is derived as follows: 



To simplify this summation, we use the identity^ 



1 



r 7^ 1 



= 2iV+l; r=l 



(3.52) 
(3.53) 



and get 



JNco 



e-J^ - 1 
(e- 



g-j0.5a> ^^-j(N+0.5)oj _ gj(N+0.5)o,^ 



g—j0.5a>^g—j0.5a> gjO.Sco'j 

sin[(A' + 0.5)0;] 

(W ^ 0 

sin[0.5<w] 

2N +\ w = 0 



which is shown in Figure 3.21. 



X,(n) 



0 1 2 3 4 5 



Figure 3.20 A rectangular pulse function. 



= Proof: 

- r") 



2—in= 



• + 1 + r + + • 
('--l)E,t-«^" andE„l-iv 



■ + ;'-' + 1 + r + ^2 + ... + _|_ ^JV+i) _ (^-w _|_ 



Therefore E,'L-a' ('■"^' - r") = 
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Using the time-shifting property, we can find the DTFT of the sequence 
Xr2{n) — x\{n — N) as 

;A/,,sin[(iV + 0.5)ct)] 

Xrlien = g"' ■ rn c i (3.54) 

sin[0.5ft;] 



where Xr2{n) 



Example 3.11 



1 0<n <2N 
0 otherwise 



Let us find the IDTFT of a rectangular spectrum (e^") which is shown as the 
magnitude of an ideal lowpass filter in Figure 3.7a with a cutoff frequency of coc. 



h(n) = — f H{ej'")e''^"da) 
— / e"'"'da) 

2^ J-COc 



lit \ jn 



-aic 



1 COi: 

= — sin(ftJcn) — — sinc(tti(.«) (3.55) 
nn n 
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Inverse DTFT of the ideal lowpass filter 
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Figure 3.22 The inverse DTFT of an ideal lowpass filter. 



This is a line spectrum which is shown in Figure 3.22. It is interesting to com- 
pare the general shape of the rectangular pulse function and its frequency 
response X^ie-'") with the frequency response H{e^'^) of the lowpass filter and 
its inverse DTFT h{n) which are derived above. However, it should be noted that 
they are not duals of each other, because Xr(e^™) is not exactly a sine function 

of (jD. 



3.4.2 Multiplication Property 

When two discrete -time sequences are multiplied, for example, x(n)h{n) — y{n), 
the DTFT of y{n) is the convolution of X{e'") and that is carried 

out in the frequency domain as an integral over one full period. Choosing the 
period [—n n] in the convolution integral, symbolically denoted by X(e'")* 
H{e^") — we have the property 

x{n)h{n) ^ — / X{e''^)H{e'^'"-'^^)dg (3.56) 

Remember that we will use (3.55) and (3.56) in the design of FIR filters discussed 
in Chapter 5. 

Example 3. 12 

The properties and the DTFT-IDTFT pairs discussed here are often used in 
frequency-domain analysis of discrete-time systems, including the design of 
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filters. However, as mentioned earlier, they can also be used in time-domain 
analysis, particularly when the z-transform technique cannot be used. To illustrate 
this point, we provide the following examples. 

Let the unit impulse response of a discrete-time system be given as h(n) = 
{0.2)"u{n) and the input sequence be given as x(n) = (0.5)~"m(— «). Therefore 



1 e}'" 



1 - 0.2e-^<" e}'^ - 0.2 
1 e-j'^ 



1 - 0.5e-"" g--"" - 0.5 



eJ'" - 0.2 / V e-J'" - 0.5 



Now let 



e^® - 0.2 e-^® - 0.5 

so that we can easily obtain the inverse DTFT of each term. Note the difference 
in the two terms. 

Then we compute ki from the following method, which is slightly different 
from the partial fraction method we have used earlier: 



Yiene-J^ieJ'' - 0.2) = —. — ]=ki + — 

\e-J'"-0.5j (e-^"-0.5) 

Evaluating both terms at e-''" = 0.2 yields 



h = 



e-i'" - 0.5 



eJ">=0.2 



= A = uii 

4.5 



Similarly, the constant k2 is evaluated as follows (again, this is slightly different 
from the partial fraction expansion method we have used earlier): 

_ 0.5) = + = 

eJ'"-0.2 XeJ'^-O.lJ 

Evaluating the two terms at e-''" = 2.0 yields k2 = -f^ = l.lll. Therefore we 
have Y(ej'") = l.Ule''" /(eJ'" - 0.2) + l.llle->/(e--'<" - 0.5), and the output 
is yin) = l.lll(0.2)"M(n)-M.lll(0.5)-"M(-n). 

Now we describe a preferred method of finding the inverse DTFT of 

Yiej") = H{e^'')X{e}'') = ( -J^ — ^ ( — \ 
^ ^ V ^ V ^ \eJ'o _ 0.2 J \e-J'^ - 0.5 J 
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which we express in the form of 



1 



(1 -0.2e-'"')(l -O.Se^'") 



where each term in the denominator is of the general form {I — ae or 
(1 — ae^'"). The partial fraction expansion is now chosen to be in the form of 



+ 



K2 



(1 - Q.le-j'^) (1 - 0.5e>) 
The residue A"! is determined by evaluating 

1 



Similarly K2 = y(e-"")(l - 0.5e-"") 



Example 3. 13 



1 



= 1.1111 



eJ'"=Q.2 



(1 - 0.2e-J'^) 



= 1.111 



Let x(n) = e'(0-3'^«) and h(n) = i0.2)"u(n). As in Example 3.12, we can find the 
DTFT ofx(n) = eJ(0-3'^«) as XieJ'^) = 2jtJ2Sico- 0.3jt - Ink) and the DTFT 
of h{n) as 

„(0 = f_L_) = (_^) 



Thus 



00 

= 2n J2 Sia)-0.3n -27tk)Hiej^-^'') 



k=—oo 

^JO.Stt -1 

— 2jT}Sico-0.37t-2nk) 

(gj0.3;r - 0.2) J ^ 

= [I.1146e--'('^ i^i^>]2;r^5(a)-0.3;r -2;rA:) 

Therefore y(n) = [I.1146e--''(° i*i3>] e-'^O-^''") = I.ii46e^(0-3;rn-0.i8i3) 

As an alternative method, we recollect that from the convolution of e^'"" and 
h(n), we obtained y(n) = eJ'"" H(ej'^). In this example HieJ'") = [e-'™/(e-'"' - 
0.2)] and ft) = O.Btt. Therefore y{n) = ej0.3;rn^(g;0.37r). 



yin) = ej^-^""" 



(e;0.37r _ 0.2) 



= 1.1146e^(0.37rn-0.1813) 
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By this method, we can also find that when the input is Re{x(n)} = cos(0.3;rn), 
the output is given by yin) = Re{l.lU6ej^^-^'"'-^-^^^^^} = 1.1146cos(0.3;rn - 
0.1813). 

3.4.3 Conjugation Property 

Here we assume the samples x{n) to be complex-valued and in the general form 
x{n) = {ae^^Y and the complex conjugate to be x*{n) = iae~-'^)". 
Let us find their DTFT: 

oo 

xin) <^ = J2 («^^'')" 

n=— 00 

oo 
n=—oo 

oo 
n=—oo 

oo 

«=— 00 

Now we replace co by -co in ZiCe-'"') to get ZiCe"^"') = E^^-oo(«)"«?~-'^" 
and its conjugate is obtained as Z|(e~-''"): 

00 

n=—oo 

In words, this result X^(e~''^) = Xiie''") means that we find the DTFT of the 
complex conjugate sequence (ae~^^)" and replace co by —o) and then find the 
complex conjugate of the result, which is the same as the DTFT of the sequence 

However, when x(n) is real, we know that x{n) = x*(n), in which case 
Zi(e-"") = X2iej'"). So we have the following result: 

XiieJ'^) = Xlie-j"') when is real (3.57) 

3.4.4 Symmetry Property 

From the result in (3.57), the following symmetry properties can be derived when 
sequence x(n) is real: 

Re{Z(e-''")} = Re{Xie-j'^)] (3.58) 
Im{Z(e-''")} = -Im{X(e->)} (3.59) 
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\Xiej'")\ = \Xie-j'")\ (3.60) 
Ang = -Ang (3.61) 

The even and odd parts of the sequence x(n) are defined by Xein) = [x(n) + 
x{—n)]/2 and xo(n) = [x{n) — x(—n)]/2 respectively. When x{n) is real, and 
we use the time reversal property, we get Xein) 4^ [{X(e^^)} + {X(e~j '")}]/!] = 
Re{X(e-'<»)}: 

Xein) 4^ Re{Z(e-''")} (3.62) 

Similarly, xo(n) ^ [{X(e-''^}] - {X(e--''^)]]/2 = yIm{Z(e-''")}: 

xoin) ^ 7lm{Z(e^")} (3.63) 

From (3.60) and (3.61), we see that the magnitude response |Z(e^'")| is an even 
function of co and the phase response is an odd function of 

The basic properties of the discrete-time Fourier transform and examples of 
some common DTFT-IDTFT pairs that have been described above are listed in 
Tables 3.1 and 3.2. 

TABLE 3.1 Properties of Discrete-Time Fourier lyansform 



Time Domain Frequency Domain 



Property 


x{n), JCi(n), X2(n) 




XieJ'"),XiieJ'^),X2ie}'") 


Linearity 


ax\{n) + bx2{n) 




aXiieJ'") + bX2ie-i'-') 


Convolution 


xxQi) *X2(n) 




Xiie}"')X2iej'^) 


Time shifting 


xin — k) 




e-i'-^i^Xiei") 


Frequency shifting 


e^'"»"x(«) 




jf(ey(ffl-<»o)) 


Time reversal 


x{—n) 




X(e->) 


Multiplication 


xi(n)x2(n) 




(l/2jr) Xi(e-'<)X2(e^'(«'-")rf? 


Differentiation 


nx(n) 




jidXienMdco 


Conjugation 


x*(n) 




X*(e->) 


Even part of x{n) 


Xein) = ^[xin) + xi- 


■«)] 


Re{X(e-''»)} 


Odd part of x(n) 


xoin) = j[xin) -xi- 


-«)] 


j\m[Xien} 


Sjmimetry 






Re{X(e>)} = Re{X(e->)} 








Im{X(e>)) = -Im{X(e->)} 








Z = Z(e->) 








Ang Xie'") = -Ang X(e--''") 



USE OF MATLAB TO COMPUTE DTFT 



147 



TABLE 3.2 Common IDTFT-DTFT Pairs 



Signal (lDTFr):x(«) Discrete-Time Fourier Transform (DTFT):Z(eJ") 



S(n) 


1 




U yfl IK } 






1 (for all n) 








27r YlT=-oo S((t}-a)o- Ink) 




cos(ct)o^) 


2.^;t=_oo o(,<W — &)0 — Z,7tK) + 0(0) + 0)0 


— Z7tK) 


sin(<won) 


J 'E,T=-oo ^(<w - Wo - 2:7rA:) - 3(w + wq 


-Ink) 


e~'"^u(n)\ \a\ < 1 


1 / /" < — /7 — //"fix 

1/(1 — e ■''") 




a"u(n); \a\ < 1 


1/(1 -flg-''") 




na"u(n); \a\ < 1 


ae--''"/(l -ae->)2 




(n + l)a"u(n); \a\ < 1 


1/(1 -ae-j^'f 




. . 1 1 \n\<N 
" 1 0 \n\>N 


&m(N + 0.5)o)/ sin(0.5«) 




(1/jrn) sin((Wcn) 


1 1 \o)\< a)c 
1 0 |w| > o)c 




u{n) 


1/(1 - + 7T _^ 5(« - 27rfe) 





3.5 USE OF MATLAB TO COMPUTE DTFT 

If a function is a finite sequence, such as the unit impulse response of an FIR filter 
H{z~^) = J2k=o bkZ~^, then the difference equation for that filter is given by 

M 

y{n) = Y^bkx{n-k) (3.64) 
We find its frequency response or its Fourier transform (DTFT) to be 

M 
k=0 

where the frequency response for this FIR filter is given by 

A' 

Hiej'") = ^bke-j'^'' (3.65) 

Jt=0 

It is also the DTFT of the signal h{k) = [bo, bi,b2,..., ^jvl- 
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Suppose that we are given the transfer function of an IIR filter: 



There are two equivalent approaches to find the frequency response of this filter 
as described below. 

We find the inverse z transform h{n) of H(z~^), which gives an infinite number 
of samples of its unit impulse response, and now we can evaluate its frequency 
response or its DTFT as H(e~j'") = Yl'^Qh{n)e~^'^^ . The other approach uses 
the difference equation y{n) + ciky{n — k) = X!^o t>kx(n — k) and finds 
the DTFT of both sides as given by 



'+E 



M 



—jcok 



-jmk 



*:=0 



so that 



(3.66) 



In short, we can state that H{e~^'^) = H{z~^)\^^^jio, provided both exist. 

To compute and plot the magnitude, phase, and/or the group delay of the FIR 
or IIR filter transfer functions H(z~^), we use the MATLAB functions frecrz, 
abs, angle, unwrap, grpdelay very extensively in signal processing and 
filter design. These functions are found in the Signal Processing Toolbox of 
MATLAB. 

When the sequence of coefficients bk and ak are known, they are entered as 
the values in the vectors for the numerator and denominator. The function f reqz 
is used with several variations for the input variables as described below: 



[h,w] = f reqz (num, den, w) 

[h,w] = f reqz (num, den, f, Fs) 

[h,w] = f reqz (num, den, K, Fs) 

[h,w] = f reqz (num, den, K, ' whole' ) 

[h,f] = f reqz (num, den, K, ' whole' , Fs) } 



The vectors num and den are the row vectors of the numerator and denominator 

coefficients and b/^, respectively. The function freqz computes the values 
of the frequency response as a column vector h at the discrete values of the 
frequency w. The set of default frequencies w he between 0 and n, and the set f 
is the vector of values for the frequencies we can arbitrarily distinguish between 
0 and Fs/2, where fs is the samphng frequency in hertz. We can choose a value 
for K as the number of frequency points within the default range; preferably k 
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is chosen as a power of 2 such as 256, 512, or 1024 to get faster computation. 
When K is not specified, the default value of 512 is chosen by the program. When 
we include the argument ' whole' in the function f reqz, the frequency range of 
w and f changes to [0 2jt] and [0 F^], respectively. 

After we have computed the values of the frequency response at the dis- 
crete frequencies, we can compute their magnitude using h = abs (h) or the 
magnitude in decibels using HdB=20*logio (H) . The phase response (in radi- 
ans) of the filter is obtained from the function ph=angle (h) , and then we can 
use Ph=unwrap (ph) to unwrap the phase response so that the phase angle lies 
between 0 and Ijt. The group delay of the filter is computed by the MATLAB 
function grpdelay (and not from the function freqz) as follows: 

[gd, w] =grpdelay (num, den, K, ) 

[gd, w] =grpdelay (num, den, K, ' whole' ) 

Note that we can change the name for the variables num,den,h,H, 
HdB, f , FT, K,ph, Ph,gd in the statements above to other variables as we like. 
After we have computed H,HdB, ph,Ph,gd, we plot them using the plotting 
function with different choices of variables, as illustrated in the examples given 
below. When we plot h, Hdb, ph, Ph, or grpdelay, we normally plot them 
as a function of the normalized frequency on a linear scale, between 0 and n. 

But the function semilog { ) plots them as a function of logio (w) and 

therefore a plot of semilog (HdB) becomes the familiar Bode plot of the digital 
filter; alternatively, we define ww = logio (w) as the new frequency variable 
and plot the magnitudes using plot (ww, H) or plot (ww, HdB). 

The MATLAB function freqz (num, den) without any other arguments com- 
putes and plots the magnitude in decibels as well as the phase response as a 
function of frequency in the current figure window. 

Example 3.14 

%Program to compute and plot the magnitude and phase responses 
% of a filter 

b=[0.0532 0.3725 1.1176 1.8626 1.8626 1.1176 0.3725 0.0532]; 
a=[1.0000 1.5473 2.1992 1.2240 0.8269 0.0347 0.0587 -0.0790]; 

[h,w] =freqz (b,a,256) ; 
H=abs (h) ; 
HdB=20*loglO (H) ; 
ph=angle (h) ; 
Ph=unwrap (ph) ; 

[gd, w] =grpdelay (b, a, 256) ; 
subplot (1,2,1) 
plot (w, H) ;grid 

title (' Magnitude of the frequency response') 
ylabel ( 'Magnitude' ) 
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xlabel (' Normalized frequency') 
subplot (1,2,2) 
plot (w, HdB) ; grid 

title (' Magnitude in dB of the frequency response') 

ylabel (' Magnitude in dB' ) 

xlabel (' Normalized frequency') 

figure ( 2 ) 

subplot (1,2,1) 

plot (w, ph) /grid 

title (' Phase response of the filter') 
ylabel (' Phase angle in radians') 
xlabel (' Normalized frequency') 
subplot (1,2,2) 
plot (w, Ph) /grid 

title (' Unwrapped phase response filter') 
ylabel (' Phase angle in radians') 
xlabel (' Normalized frequency') 
%end 

The magnitude response and phase response of this IIR filter are plotted 
Figures 3.23 and 3.24, respectively. 



Magnitude of the 
frequency response 



Magnitude in dB of the 
frequency response 
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Figure 3.23 Magnitude response of an IIR filter. 
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Phase response of the filter 



Unwrapped phase response filter 
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Figure 3.24 Phase response of an IIR filter. 



Example 3. 15 

Now we consider an FIR filter with a finite number of coefficients as 
[1.0 0.8 0.6 0.4 0.6 0.8 1.0]. The MATLAB script used to compute its 
frequency response and plot the magnitude and phase for the whole range of 0 
to In is shown below: 



%Program to compute and plot the frequency response or DTFT 
% of an FIR filter 
b=[1.0 0.8 O.G 0.4 0.6 0.8 1.0]; 
[h, w] =f reqz (b, 1 , 256 , ' whole ' ) ; 
H=abs (h) ; 
ph=angle (h) ; 
plot (w, H) ; grid 

title (' Magnitude of the FIR filter') 
ylabel ( ' Magnitude ' ) 

xlabel (' Normalized frequency from 0 to 2*pi') 
figure 

plot(w,ph) ;grid 
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Magnitude of the FIR filter 

I I I r 




0 1 2 3 4 5 6 

Normalized frequency from 0 to 27z 

Figure 3.25 Magnitude response of an FIR filter. 



title ('Phase response of the FIR filter') 
ylabel (' Phase angle in radians') 
xlabel (' Normalized frequency') 
%end 

The magnitude and phase responses for the normalized frequency range from 
0 to 271 are shown in Figures 3.25 and 3.26, respectively. The phase response is 
found to be linear as a function of the frequency in this example. We will work 
out many more examples of computing and plotting the DTFT or the frequency 
response of filters in Chapter 4, using the MATLAB functions listed above. 

Example 3.16 

In this example, we choose the sampling frequency Fs — 200 Hz, and the Nyquist 
interval is divided into 100 equal parts as seen in the statement f = [ o : 9 9 ] in the 
MATLAB program given below. The sample values of the signal are entered by 
us, when prompted by the program. In the example, we entered [0.4 0.6 0.8] 
as the input signal. The magnitude and phase are plotted in Figure 3.27 as a 
function of the frequency from 0 to 100 Hz. But the group delay is plotted as a 
function of the normalized frequency from 0 to tt radians. 

% Program to compute and plot the magnitude and phase and 
% group delay of an FIR filter 
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Phase response of the FIR filter 




1 2 3 4 5 

Normalized frequency from 0 to 2tt 

Figure 3.26 Phase response of an FIR filter. 
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Figure 3.27 Magnitude, piiase, and group delay responses of an FIR filter. 
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b=input ( ' Type the values of the signal'); 

a=l; 

f=0:99; 

Fs=2 0 0; 

[H, w] =f reqz (b, a, f , Fs) ; 
mag=abs (H) ; 
DB=20*loglO (mag) ; 
phase=angle (H) ; 

[grp, w] =grpdelay (b, a, 256) ; 
subplot (2,2,1) 
plot (f ,mag) ;grid 

title (' Magnitude response of the filter') 
ylabel ( ' Magnitude ' ) 
xlabel ( ' Frequency in Hz ' ) 
subplot (2,2,2) 
plot (f ,DB) ;grid 

title ( 'Magnitude response in dB') 

ylabel (' Magnitude in dB' ) 

xlabel ( ' Frequency in Hz ' ) 

subplot (2,2,3) 

plot ( f , phase) /grid 

title ('Phase response') 

ylabel (' Phase angle in radians') 

xlabel (' Frequency in Hz') 

subplot (2,2,4) 

plot (w, grp) ;grid 

title ('Group Delay response')) 

ylabel ('Group Delay in samples')) 

xlabel ( 'Normalized frequency' ) 

%end 

3.6 DTPS AND DFT 
3.6.1 Introduction 

We discussed the DTFT-IDTFT pair for a discrete-time function given by 



oo 




(3.67) 



n——oo 



and 




(3.68) 
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The theory for deriving the pair and their properties and applications are very 
elegant, but from practical point of view, we see some limitations in computing 
the DTFT and IDTFT. For example, the input signal is usually aperiodic and may 
be finite in length, but the unit impulse response of an IIR filter is also aperiodic 
but infinite in length; however, the values of its samples become almost negligible 
in many practical applications as n becomes large but finite. So in (3.67), it is 
reasonable to assume that the number of terms is finite, but is a function 

of the continuous variable (o. We have given some examples of analytically 
deriving closed-form expressions for this function and plotting it as a function 
of the variable co. We showed how we can do it by using MATLAB functions. 

Let us consider one more example of a discrete-time function x(n) and its 
DTFT X{e^"). Figure 3.28a shows a nonperiodic discrete-time function x{n) 



x(n) 



01 2345678 



(a) 

|X(e^")| 
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that is of finite length. Figure 3.28b,c show the magnitude response 
and phase response ZZ(e^") of the DTFT X{ej'^). 

The function X(e-'") in (3.68) is a function of the continuous variable co, 
and the integration is not very suitable for computation by a digital computer. 
Of course, we can discretize the frequency variable and find discrete values 
for where a>k are discrete values of the frequency. In contrast to the 

case of a continuous-time signal with a frequency response X(jct)), we notice 
that we need to compute the DTFT at only a finite number of values since 
X(e-'") is periodic, and therefore we need to compute it over one period only. In 
(3.68), xin) can be computed approximately, if the integration is substituted by 
a summation and such a summation will be finite because the values of X'(e^'*'*^) 
have to be chosen only over the interval [—it, n]. [We may also note that the 
reconstruction formula used to obtain x{t) from its samples x(n) is not suitable 
for digital computer, either.] These limitations are mitigated by a theory based on 
the model for a discrete-time signal that is periodic, and in the next section, we 
describe the discrete-time Foiuier series (DTFS) representation for such discrete- 
time periodic signals. This theory exploits the property of the DTFT that it is 
periodic, and hence we need to use only a finite frequency range of one period 
that is sufficient to find its inverse. 



3.6.2 Discrete-Time Fourier Series 

We consider a discrete-time aperiodic signal x{n) that is finite in length equal to 
A'^ samples and generate a periodic sequence with a period so that it satisfies the 
condition Xp(n + KN) = Xp(n), where K is any integer. The complex Fourier 
series representation of this periodic signal contains the sum of the discrete-time 
complex exponentials e^^'^", where = 2it/N is its fundamental frequency and 
(ii)Qk is its feth harmonic. The Fourier series is a weighted sum of the fundamental 
and higher harmonics in the form Xp{n) = Y^k^QXp{k)e^'^'^'^ , where Xp(k) is 
the coefficient of the ^th harmonic in the Fourier series. These coefficients are 
complex-valued in general and hence have a magnitude and a phase: Xp{k) = 
\Xp{k)\AXp{k) 

In Chapter 1, we pointed out an important property of the discrete-time expo- 
nentials (in contrast to the continuous-time exponentials e^'^^^*) that the exponen- 
tials with frequencies that are separated by integer multiples of In are the same 

^j((ao±2n)k _ ^jcook^j±2jtk _ ^jcook (3.69) 

and therefore the coefficient of the complex Fourier series Xpik) — Xp(k ± A'). 
Consequently there are only independent harmonics (in contrast to the infinite 
number of harmonics in the case of the continuous-time periodic function), and 
we have used a subscript to denote that these coefficients Xp{k) are periodic. 
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Therefore, in its complex Fourier series form, we have 

A'-l 



Xpin) = J2 Xp(k)ei^^'"^'^'"' (3.70) 



To find these coefficients, let us multiply both sides by e -/"""o* and sum over n 
from n = 0 to (Af - 1): 



A'-l A'-l A'-l 



^ Xp{n)e-i"""^'' = ^ ^ Z^(/fe)e^'(2;r/A/)A:„g-;m<«oAr (3 j^) 

n=0 «=0 i=0 

By interchanging the order of summation on the right side, we get 



A'-l 



N~l 

j (271 /N)k(n-m) 



.n=0 



(3.72) 



k=0 

It is next shown that [J2n=o e-/^^'^/'^'*^^""'")] is equal to N when n = m and zero 
for all values of n ^ m. When n = m, the summation reduces to [J2n=o = 
A'^, and when n ^ m, we apply (3.52) and find that the summation yields zero. 
Hence there is only one nonzero term Xp(k)N in (3.72). The final result is 

^P^^^ =nY1 (3.73) 

n=0 

Now we notice that 

A'-l , A'-l 



N ^ N 

n=0 «=0 



In other words, when the DTFT of the finite length sequence x(n) is evaluated 
at the discrete frequency cok — {2n/N)k, (which is the feth sample when the 
frequency range [0, In] is divided into A^ equally spaced points) and dividing 
by A^, we get the value of the Fourier series coefficient Xp{k). 

The expression in (3.70) is known as the discrete-time Fourier series 
(DTPS) representation for the discrete-time, periodic function Xp{n) and (3.73), 
which gives the complex-valued coefficients of the DTFS is the inverse DTFS 
(IDTFS). Because both Xp (n) and Xp (k) are periodic, with period A^, we observe 
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that the two expressions above are valid for — oo < n < oo and — oo < k < oo, 
respectively. Note that some authors abbreviate DTPS to DPS. 

To simplify the notation, let us denote e-i(2;r/A')n jj^^j (3.70) and 

(3.73) are rewritten in compact form for the DTPS-IDTPS pair as 

N~l 

Xp{n) = ^ Xp{k)W~''", -oo < n < oo (3.75) 

k=Q 

Xp{k) = — ^ Xp(n)W'"', -oo < < oo (3.76) 

^ n=0 

Pigure 3.29a shows an example of the periodic discrete-time function Xp(n) 
constructed from Pigure 3.28a while Pigures 3.29b,c show the samples of the 
magnitude A' |Xp(/c)| and phase ZXp(k) of the DTPT at the discrete frequencies 
cok = k(ln/N), k = Q,\,2,...,{N-\). 

By comparing (3.73) and (3.67), we notice the following. Remember that 
X{e^") given by (3.67) is the DTPT of a nonperiodic sequence that may be of 
finite or infinite length. But when we assume that the signal is of finite length A^, 
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Figure 3.29 A periodic signal; (b) its magnitude response; (c) its phase response. 



DTPS AND DFT 



159 



and have Xp(n) = x{n) for n = 0, 1, 2, . . . , (Af — 1), we have its DTFT as 



In (3.73) we evaluate the DTFT at N discrete frequencies cok and divide these 
samples by N to get Xp{k). From (3.70), we see that the coefficients Xp{k) of the 
DTPS for Xp{n) are also the coefficients of the Fourier series for the discrete-time 
periodic sequence Xp{n), and they are also referred to as the spectral components 
of Xp{n). In other words, the Fourier series coefficients of a periodic signal Xp{n) 
is \/N times the DTFT of x{n) evaluated at the discrete frequencies w^. We 
repeat that Xp{k) = (l/Af)Z(e-'""=), where X(e-"«) is the DTFT of a sequence 
x{n). This result is based on the assumption that x{n) is a sequence of finite 
length A'^. 

3.6.3 Discrete Fourier Transform 

We will discuss some properties of the DTFS-IDTFS pairs later in this section. 
Here we use the argument that if (3.75) is valid for all values of n (i.e., for 
— oo < n < oo), it is valid for 0 < n < — 1 or for any sequence of length 
N; similarly, (3.76) is valid for 0 < ^ < - 1. Thus we denote Xp(k); 0 < 
n < A^ — 1 by the notation X{k), whereas we already have represented x{n) = 
Xpin); 0<n<N -I: 

N-l N-l 



Note that we have not derived these properties from any new theory but only 
defined them as a part of the infinite sequences for the DTFS and IDTFS derived 
above. 

Also note that whereas (3.75) is termed the discrete-time Fourier series (DTFS) 
representation of Xp(n), in which Xp(k) are the coefficients of the Fourier 
series [and (3.76) is the IDTFS], it is (3.78) that is known as the discrete-time 
Fourier transform (DFT) [and (3.77) is known as the inverse DFT (IDFT)]! In 
Sections 3.6.1 and 3.6.2, note that we have used different notations to distinguish 
the DTFT-IDTFT pair from the DFT-IDFT pair. 

In most of the textbooks, and in MATLAB, the DFT-IDFT are simply defined 
as given below, without any reference to the theory for deriving the DTFS, from 
which the DFT are selected. Also note that the scale factor (1/A^) has been moved 
from (3.78) to (3.77) in defining the DFT-IDFT pair as shown in (3.79) and (3.80) 







N-l 



N-l 
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(we will use these two equations for the DFT-IDFT pair in the remaining pages): 

0<n<N-l (3.79) 



0<k<N -I (3.80) 

In Figure 3.29b, we have shown the DFT as a subset of the Fourier series 
coefficients Xp(k), for k = 0, 1,2, . . . , (N — 1). But we can choose any other 
N consecutive samples as the DFT of x{n) [e.g., —[{N — l)/2] < n < [(N — 
l)/2]], so we will use the notation (A^) = n modulo to denote that n ranges 
over one period of A' samples. 

Given a nonperiodic discrete- time function x(n), we constructed a mathe- 
matical artifact Xp(n) and derived the Fourier series representation for it and 
also derived its inverse to get Xp(n). Then we defined the DFT and IDFT as 
argued above so that we could determine the frequency response of the non- 
periodic function as samples of the DTFT X{e^'") at N equally spaced points 
(W^. = {2TT/N)k. We know x{n) is nonperiodic, but since Z(e-'") is periodic with 
a period In, Z(e^"*) — Xpik) is periodic with a period A^, so one can choose 
the range n = (A'^) in Equations (3.79) and (3.80). 

The two equations for the DFT and IDFT give us a numerical algorithm 
to obtain the frequency response at least at the A'^ discrete frequencies, and 
by choosing a large value for N, we get a fairly good idea of the frequency 
response for x{n).^ Indeed, we show below that from the samples of X{k), we 
can reconstruct the DTFT of x(n) = Z(e'"), which is a function of the contin- 
uous variable co. This is the counterpart of Shannon's reconstruction formula to 
obtain x(t) from its samples x(n), provided xin) is bandlimited and the sam- 
pling period Ts < (n/cob). There are similar conditions to be satisfied in deriving 
the formula in the frequency domain, to reconstruct Z(e-'"') from its samples 
Z(e-''"*) = Xik). 

3.6.4 Reconstruction of DTFT from DFT 

First we consider the DTFT of xin) and substitute x(n) by the formula (3.79) 
for finding the IDFT of X{k) as explained below: 

N-l N-l 

Xien = J2^(n)e-J^" = J2 

n=0 n=0 

= — J2 X(k) J2 6'^(2"*"/^^e--'"'" (3.81) 

^ k=Q n=Q 

^Later we will discuss what is known as the "picket fence effect," because of which we may not get 
a fairly good idea of the frequency response. 



^ A'-l ^ N-l 

xin) Xik)ei^^'"^^^'' = - ^ Xik)W-^'', 

k=0 k=0 

N-l N-l 

Xik) = ^x(n)e-^'(27r/Af)te ^ J2xin)W'"', 

«=0 n=0 



kn/N) 



k=0 



-ja>n 
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Now we use (3.52) in the summation J2n=o e^^^^^'^l^^e and reduce it as 
follows: 



N-\ 

E 

n=0 



^j(2Kkn/N)^-ja>n _ 



1 _ g-jlco-(2jik/N)] 



g-j[((oN-2nk)/2] 


sin 


'coN - Ink' 
2 


g-j[(coN-27Tk)/2N-^ 


sin 


'coN -Ink' 


sin 


'odN - 2nk' 
2 


-i[(o-(2nklNmN-l 


sin 


coN — Ink 


c 




IN 







(3.82) 



Substituting the last expression in (3.81), we obtain the final result to reconstruct 
the DTFT X(e-"*'), from only the finite number of the DFT samples X{k), as 
given below: 



I ^-1 

k=0 



sin 


'odN - Ink' 


2 


sin 


'(joN — Ink' 


2Ar 



-j[a>-(27TklNy\[(N-\)l2-\ 



(3.83) 



If x{n) has M samples and we sample X{e^'^) at N points in the range [0, 2n\, 
where N > M, then the -point IDFT will yield A'^ samples in the discrete- 
time domain. It can be shown that this result will give rise to aliasing of the 
//-point sequences (in the time domain). So we pad the given function x{n) with 
(M — A^) zeros to make it a discrete-time function of length A'^; otherwise, we 
have to choose A^ < M. In that case the sampling interval satisfies the condition 
{2n/N) > (2n/M), which is dual to the condition that the sampling period T < 
(1/2B) to be satisfied for Shannon's reconstruction formula in the time domain. 
To satisfy this condition for reconstruction in the frequency domain, we make 
M = N by padding with zeros x{n) to avoid aliasing in the discrete-time domain. 



3.6.5 Properties of DTPS and DFT 

We have already listed some of the properties of DTFT in Table 3.1. Since the 

samples X(k) of DFT are a subset of the Fourier series coefficients Xp(k), there 
is some similarity between the properties of Xp{k) and X{k) and also those of 
the DTFT X(e-"") of x(n). Tables 3.3 and 3.4 Ust the properties of Xp{k) and 
X(k), respectively, which also show some similarities. 

Remember again that the DFT X{k) is defined over one period usually for 
A: = 0, 1, 2, . . . , (A'^ — 1) and it is considered to be zero outside this range. So 
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TABLE 3.3 Properties of DTFs Coefficients 



Periodic Signal 



Property 


x{n) and y{n) with Period N 


Linearity 


uxin) + byiii) 


Periodic 


x(n) ® y(n) 


convolution 




Time shifting 


x(n — k) 


Prf^niipnpv Qtiiftitny 


c Ai \ fi/ ) — yy A \ii ) 


Time reversal 


x(~n) 


Multiplication 


x(n)y{n) 


Conjugation 


x*(n) 


Even part of x(«) 


Xe{n) = 5 [x(n) + x*(—n)] 


Odd part of x(n) 


xo(n) = J [x(n) - x*i-n)] 


Sjmimetry 


x(n) is a real sequence 



DTFS Coefficients Xpik) 
Xp(k) and Y,,{k) 



aXp(k) + bYp(k) 
Xp(k)Yp{k) 

g-}(2nlN)kmx^(k) = W^'"Xpik) 

Xp{k — m) 
Xp(-k) 

J!j:lZlXpim)Ypik-m) 

X*p(-k) 
Re[Xp(k)] 

j lm[Xp(k)] 

Xpik) = X*pi-k) 

Xpik) = x;i-k) 

ReXpik) = RtXpi-k) 
ImX pik) = -ImXpi-k) 
\Xpik)\ = \Xpi-k)\ 
^Xpik) = -^Xpi-k) 



TABLE 3.4 Properties of DFT Coefficients 



Property 



Signal 

x(«) and yin) of Length N 



DFT Coefficients 
Xik) and Yik) of Length N 



Linearity 
Convolution 
Time shifting 
Frequency shifting 
Multiplication 

Conjugation 
Even part of x(w) 

Odd part of x in) 



axin) + byin) 

T,m=o^('")y((n -m))N 
x(n — m)tf 

x(n)y(n) 

x*(n) 

x,(n)= i [x(«) + x*((-w))jv] 
xo(«) = 5 [x(«) - x*((-«))jv] 



aXik) + bYik) 
Xik)Yik) 

g-j(27r/N)kmx(k) = Wj^'"Xik) 

Xiik-m))N 

Tii:l'ZlXim)Yiik-m))N 

X*ii-k))N 
ReXik) 

j imXik) 

Xik) = X*ii-k))N 
ReXik) = ReXii-k))N 
ImXik) = -ImXii-k))N 
\Xik)\ = \Xii-k))N\ 
^Xik) = -lXpii-k))N 
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in Table 3.4, we have used a notation such as X({—k))N, which means that we 
choose DTPS coefficients Xp{k), use time reversal to get Xp{—k), and then 
select any A' samples that form a period. The double bracket with a subscript 
A'^ calls for three operations: choosing the DTPS coefficients Xp{k), carrying 
out the operation indicated by the index within the brackets, and then selecting 
n = 0, 1, 2, . . . , (A^ — 1) or n modulo A^. This again confirms the statement that 
all operations are carried out by the DTPS and then one period of the result 
is chosen as the DPT of x(n). This is very significant when we carry out the 
periodic convolution of the DTPS of x{n) and f{n) and select the values of this 
convolution for n = 0, 1, 2, . . . , (A' — 1). We illustrate this by Example 3.17. 

Example 3.17 



Let x{n) = [1.0 1.0 0.6 0.6] and /(«) = [1.0 0.6 0.4]. We can easily 
find the output yi{n) by using either one of two methods: (1) the convolution 



sum yi(n) — x{n) * f{n) — ^„,Zo x(m)f(n — m) or (2) one of the two trans- 
forms, namely, the z transform or the discrete-time Pourier transform (DTPT) of 
x{n) and f(n), and find the inverse z transform of [X{z)F{z)] or the inverse 
DTPT of [Z(e^™)F(e^'")]. Indeed, we can give a proof to show that the z 



I x(m) 



0 12 3 

(a) 

|f{1-m) 



-2-1 0 12 3 
(C) 



\ f{3-m). 



0 12 3 
(e) 



I f(-m) 



-3-2-1 0 12 3 m- 
{b) 
|f(2-m) 



-10 12 3 m - 
I f(4-m) 



0 1 2 3 4 m 
(0 



Figure 3.30 Linear convolution of x{n) and /(«). 
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I f(5-m) 



I f(6-m) 



0 12 3 4 5 
(9) 



,yi(n) 



0 1 2 3 4 5 6 m- 



0 12 3 4 5 
(') 



Figure 3.30 (Continued) 



transform of the convolution sum yi(n) — x{n) * f{n) is [X(z)F(z)]. There- 
fore, the results from both these methods agree with each other and we get 
the output yi{n) — [1.0 1.6 1.6 1.36 0.6 0.24], which is a sequence of 
length 6. It is identified as the result of linear convolution. The three sequences 
are shown in Figure 3.30, including the graphical procedure for carrying out the 
linear convolution. 

Now we ask the following question. What do we get if we compute the DTPS 
of the periodic sequences Xp(n) and fp(n) generated by extending x{n) and 
fin), multiply Xp{k), and Fp{k), and find the inverse DTPS of their product 
[Xp(k)Fp{k)'\ to get jpin). Prom Table 3.3, we notice that [Xp{k)Fp{k)'\ is 

the DTPS of the periodic convolution x{n) ® f(n) — ^^=o ^i'^)fi^^f^)N — 
yp{n) — a result than can be proved analytically. We will provide a numerical 
example below to verify this property. However, does this result of periodic 
convolution match with the result of applying the familiar linear convolution? 
We show in the example chosen below that yp{n) is not the periodic extension 
of y\{n), that is, the result of the periodic convolution and the linear convolution 
do not match in the example chosen. 

Example 3. 18 

The DTPS coefficients of x(n), when we choose N = 4, are computed from the 
formula Xp{k) = j»;(n)e->(2;r/iV)te 

XpiO) = ^x(n)e-^(2-/^)(0«) = x(0)e-^(2-/4)(0) +;c(l)e-^(2-/4)(0) 
n=0 

+ x(2)e->(2./4)(0) ^^^3)^-;(2./4)(0) ^ 3 2 
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«=o 

+ ^(2)e-^(2-/4)(2) + x(3)e-^(2-/4)(3) = o.4 - jOA 
«=o 

+ ^(2)e-^(2'^/4)W +jc(3)e-^(2'^/4^(^> = 0.0 + yO.O 

n=0 

+ ;c(2)e-^(2-/4)(6) +;c(3)e-^(2'^/4)(^) = 0.4 + yO.4 
Similarly, the DTFT of f(n) are computed as 

n=0 

+ /(2)e-^(2-/4)(0) + /(3)e-^(2./4)(0) ^ 2.0 

Fp(l) = = /(0)e-^(2;r/4)(0) ^ j.(l)g-;(2^/4)(l) 

+ /(2)e-^(2-/4)(2) + ^(3)g-7(2;r/4)(3) ^ Q g _ jq ^ 

n=0 

+ /(2)e-^'(27r/4)(4) ^ ^(3)g-;(2;r/4)(6) ^ g.g + jO.O 

3 

Fp(3) = ^ /(n)e-^(2ViV)(3.«) ^ y(0)e-;(2-/4)(0) + y(iy-;(2;r/4)(3) 
+ /(2)e->(2;r/4)(6) ^ ^(3)^-,(2./4)(9) ^ q ^ _^ jq ^ 

The term-by-term product of these vectors gives the DTPS of the output 
Ypik) = Xp{k)Fp{k) as 

Yp{k) = [6.4 0 - 70.48 0 + jO 0.0 + jO.48] 

and its inverse DTPS is computed from the formula 

*:=0 

and we get yp{n) = [1.6 1.84 1.6 1.36]. 
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Using the fomiula for the periodic convolution x(n) ® f (n) = 
X!m=o ■^('")/('^ ~ directly, as illustrated in Figure 3.31, we get the 
same result for yp{n). This verifies the property that the DTPS of the periodic 
convolution x{n) ® f{n) is Xp{k)Fp{k). 



A Xp(m) 
I 



-10-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 
(a) 

; 'p(m) 



-7-6-5-4-3-2-1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 
(f) 

l<p(-m) 



-10-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 
(c) 

fn, 



|ip(1-m) 



-10-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 



p(2-m) 



-10-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 
(e) 

Figure 3.31 Circular (periodic) convolution of Xp{n) and fp{n) with N = 4. 
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V(3-m) 



-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 

(0 



A f(4-m) 
I 



-11-10-9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 m ■ 

(g) 



o(5-m) 



-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 m 
(") 



Ay(n) 



-12-11-10-9 -8-7-6-5^-3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 n ^ 

(0 

Figure 3.31 (Continued) 



But we notice that this does not match the result of the linear convolution 
= x(n) * /(n) = [1.0 1.6 1.6 1.36 0.6 0.24]. It is obvious that the 
length of yi(n) is 6, whereas Xp{n), fp{n), Xp{k), Fp(k), and yp{n) are all of 
length 4, and for that reason alone, we do not expect the two results to match. 
If we look carefully at Figure 3.31 and Figure 3.30, we see another reason why 
they do not match. In Figures 3.31, /(4 — m), f(5 — m), f{6 — m), f(l — m) 
are found to be the same as the sequence /(O), /(I — m), f(2 — m), /(3 — m). 
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respectively; therefore yp(n) is periodic with a period N = 4, whereas yi(,n) is 
nonperiodic and is of length 6. When computing ypin), we see that products of 
the additional terms from the adjacent period are added, whereas when computing 
yiin), no such overlap takes place. So in order to avoid this overlap, we choose 
N = S and compute Xp{k), Fp{k) and ypin) as follows. 

Example 3. 19 

«=o 

= x(0)e-^(2-/8)(0) + jc(l)e-^(2-/8)(0) + x(2)e-'(2-/8)(0) 
+ ;c(3)e-^'(2./8)(0) ^ . . . ^ ^(7)e-^(2./8)(0) ^ 3 2 

Zp(l) = ^x(n)e-^(2;r/iV)(i.„) 

n=0 

+ Jc(3)e"-'^^''''*^(^^ + • • • + A:(7)e"-'<^''/*^(^^ = 1.2828 - 71.7314 
Zp(2) = ^x(n)e-^(2-W(2.„) 

n=0 

+ .t(3)e-^(2'^/»)(«> + • • • + .t(7)e-^(2'^/»)(i4> = 0.4 - 7O.4 
X^(3) = ^x(n)e-^(2-/'V)(3-«) 

n=0 

+ Jc(3)e-^'(2;r/4)(9) ^ . . . ^ ^^^^^_;(2;r/8)(21) ^ 0 7^72 - 70.5314 

Zp(4) = ^x(R)e-^(2./iV)(4.„) 

n=0 

= x(0)^'-^(2-/8)(0) + + x(2)e--'(2-/8)(8) 

+ x(3)e-^(2-/4)(12) + . . . + x(7)e-^(2-/8)(28) = Q.O + 7O.O 
n=0 

= x(0)e-^'(2;r/8)(0) ^ ;,(l)e-7(2-/8)(5) + ;,(2)e-^-(2;r/8)(10) 

+ Jc(3)e-^(2'^/4)(15) ^ . . . ^ ^(7)g-,(2;r/8)(35) ^ o.7172 + j0.5314 
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= x(0)e-^^(2-/8)(0) +;c(2)e->(2;r/8)(12) 
+ x(3)e-^(2'^/4>(i«> + • • • + x(7)e-^(2-/S)(56) = 0.4 + jOA 

= x(0)e-^^(2'^/«)(0) +;c(2)e-^(2;r/8)(14) 

+ x(3)e-^'(2'^/4>(21) ^ . . . ^ ^(7)^-;(2;r/8)(49) ^ i_2828 + J 1.7314. 

Similarly, we compute Fp(A;) with N = S and get the vector 

Fpik) = [2.0 1.4243 - ;0.8423 0.6 - 7O.6 0.5757 - ;0.0243 

O.8 + 7O.O 0.5757 + jO.0243 0.6 + j0.6 1.4243 + 70.8423]. 

The term-by-term multiplication of Xp(k) and Fp(k) yields 

Yp(k) = [6.4 0.4 - 73.5233 0.0 - 70.48 0.4 - 70.3233 0.0 + 7O.O 
0.4-^70.3233 0.0-^70.48 0.4-^73.5233]. 

and the inverse DTPS of Yp{k) given by ypin) = 1/A^ELo Yp{k)ei^^''l^^''" is 
computed to obtain yp{n) = [1.0 1.6 1.6 1.36 0.6 0.24 0.0 0.0]. 

As shown in Figures 3.32 and 3.33, we get the same result from the periodic 
convolution. Moreover, we see that this result matches the result yiin) obtained 
by linear convolution! 

In general, if the length of x(n) is li and that of /(«) is I2, we know that the 
length of yi (n) from linear convolution will he li + I2 — I. So what we need to do 
to match the result of linear convolution and periodic convolution of two signals 
is to choose to be equal to or greater than li + I2— 1- With such a choice, we 
can use the DTPS coefficients Xp{k) and Fp{k), each of length N > h + I2 — I, 
and then compute the inverse DTPS coefficients of Xp(k)Fp(k). Because the 
formulas for computing the coefficients of their DPT [i.e., X(k) and F(k)] are 
the same as for computing their DTPS coefficients and consequently the DPT 
(and inverse DFT) coefficients are a subset of the coefficients of DTPS (and 
IDTPS), we conclude that if we are given, say, x(n) of length h as the input 
signal and hin) of length I2 as the unit impulse response of a finear discrete-time 
system, then we can pad each of the signals with an appropriate number of zeros 
to make both of them to be of length N > h + h — i, and find the inverse DFT 
of X{k)H(k) to get the samples of the output y{n) of the linear discrete- 
time system. Conversely, if we are given any signal, we can easily obtain the A'^ 
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|xp(1-m) 



01234567 m_ 
ifp(-m) 



0 1 2 3 4 5 6 7; 

|fp{1-m) 

I 
I 



0 

|fp{2-m) 



0 1 2 
|fp{3-m 



0 12 3 4 5 6 7 

Figure 3.32 Circular convolution of Xp(n) and fp(n) with A' 



coefficients of its DFT, which indicates the frequency response of the signal at 
A' discrete frequencies equally spaced between 0 and In. 



3.7 FAST FOURIER TRANSFORM 

Note that when we computed each of the eight samples of the DFT in the previous 
example, there was multiplication of the complex number e>(27r/A')<:n _ y\^-kn^ 
k = 0, 1,2, . . . , {N — 1), with the eight real-valued samples of the signal and 
the product were added. So the total number of multiplications is 8^ — 64 and 
the number of additions are 7" — 49 in computing the eight samples of the 
DFT. The same number of multiplications and additions are required to find the 
inverse DFT; in this case, samples of both X (k) and W~''" are complex-valued. 
In general, direct computation of the DFT and IDFT using (3.79) and (3.80) 
requires A^^ multiplications and {N — 1)^ additions; so they become very large 
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t fp{4-m) 

I 



0 1 2 3 4 5 6 7 
! fp(5-m) 



-7-6-5-4-3-2-1 0 1 2 3 4 5 6 7 8 

|fp(6-m) 
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I 



-8-7-6-5-4-3-2-1 012345678 
|y(n) 



-8 -7-6-5-4-3-2-1 01 23456789 10 11 12 

Figure 3.33 Circular convolution of .Xp{n) and fp(n) with N = & (continued from 
Fig. 3.34). 



numbers when A' is chosen very large, in order to increase the resolution of the 
frequency response X(k) of a given signal or to find the unit impulse response 
of a filter as the IDFT of the given frequency response of a filter. 

Fast Fourier transform (FFT) is a numerical algorithm that has been developed 
to improve the computational efficiency by an enormous amount and is the most 
popular method used in spectral analysis in digital signal processing, specifically, 
to find the DFT of the signal and also the inverse DFT of the frequency response 
to get the discrete-time signal. This is only a computational algorithm and not 
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another transform. In this FFT algorithm, when the value for the radix N is 
chosen as 2*, where is an integer, the number of complex multiplications is 
of the order {N/2) \0g2iN) and the number of complex additions is of the order 
N log2 A^. As an illustration of this efficiency, let us choose N = 256; in this 
case the number of complex multiplications is 65,536 in the direct computation, 
whereas the number of complex multiplications is 1024 in the FFT algorithm, 
which is an improvement by a factor of 64. As increases to higher values, the 
improvement factor increases very significantly, for example, when A'^ = 1024, 
we realize an improvement by a factor of 204. 

Algorithms based on a radix N = 4 have been developed to further improve 
the computational efficiency. Also when the length of a signals to be convolved 
is large (e.g., = 1024), some novel modifications to the FFT algorithm have 
also been proposed. They are called the overlap-add method and the overlap-save 
method. Basically in these methods, the signals are decomposed as a sequence 
of contiguous segments of shorter length, their convolution is carried out in the 
basic form, and then the responses are carefully added to get the same result 
as that obtained by the direct FFT method applied on their original form. The 
MATLAB function y = fftfilt(b,x) and y = f ftfilt (b,x,N) implements 
the convolution between the input signal x and the unit impulse response b of 
the FIR filter, using the overlap-add method, the default value for the radix, is n 
512; but it can be changed to any other value by including it as an argument in 
the second command. 

3.8 USE OF MATLAB TO COMPUTE DFT AND IDFT 

Example 3.20 

Let us consider the same example for the signal x(n) that was chosen in the 
previous example; that is, let x(n) = [1.0 1.0 0.6 0.6]. First we compute 
its DTFT and plot it in Figure 3.34. Then we compute a 10-point DFT of the 
same signal using the function f ft found in the Signal Processing Toolbox of 
MATLAB. The function is described by the following simple command: 

[X,w] = fft(x,N) 

In this function, x is the output vector of the complex-valued DFT of the given 

signal x(n) and n is the value for the radix, which is chosen as 10 in this example. 
The absolute value of the DFT is computed, and the magnitude \X{k')\, k = 
0, 1, 2, . . . , 9 is superimposed on the same plot. It is seen that the values of DFT 
match the value of DTFT at the discrete frequencies gi(2;r/io)Ar^ = 0, 1 , 2, . . . , 9, 
as we expect. But we have chosen this example with A'^ = 10 particularly to 
illustrate what is known as the "picket fence effect". Note that the frequency 
response in Figure 3.34 has a local minimum value at the normalized frequency 
of 2.5 and 7.5. But if we plot the DFT values alone, we will miss the fact that the 
frequency response of the signal has a minimum value at these frequencies. This 
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DTFT and DFT values of a finite length signal 




Normalized frequency 5*w/p and k 
Figure 3.34 DTFT/DFT plot. 



phenomenon becomes serious if the signal has a single sinusoidal frequency, in 
which case the frequency response will have an impulse function and will appear 
as a spike at the corresponding normalized frequency. Because we have chosen 
a low value for A^, and therefore the fundamental frequency In/N is relatively 
large, it is likely that the presence of this single frequency will be completely 
missed. This is known as the "picket fence effect," as if we "see" the continuous 
frequency response through a picket fence and miss some part of the frequency 
response that lies behind the pickets. Hence it is important to select a fairly 
high value for the radix so that we have less chance of missing the single 
frequencies but at the same time not too high a value, which would increase the 
computation time. 

Students are strongly recommended to have a thorough understanding of the 
theory while they use MATLAB in signal processing. In this example, when we 
compute the DFT using the MATLAB function, its output is actually displayed 
for k — 1,2,3, N, since the MATLAB function computes the f ft of x(n) 
according to the algorithm 

1) = ^x(n+ 1)W^" (3.84) 

n=0 

and the inverse DFT is computed for n = 1, 2, 3, . . . , from 

xin + l)^ -Y Xik+l)W-''" (3.85) 

k=Q 
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whereas from theory we know that both indices run from 0 to (A^ — 1) and the 
frequency response is normally displayed by MATLAB for the frequency range 
of [0 nl 

In superimposing the values of DFT on the plot for the DTFT, this fact about 
the MATLAB function f ft is important. It serves as an example where a thor- 
ough understanding of theory is necessary for using MATLAB in digital signal 
processing. 

Example 3.21 

We now consider another example showing the use of the MATLAB function 
fft(x,N) and comparing the values of its DFT with the frequency response 
(DTFT) of a discrete-time signal. We pick a signal x{n) — sin[0.1(7rM)] for 0 < 
n < 10, which is plotted in Figure 3.35. We find its frequency response using the 
function [h,w] =freqz (x, 1, 'whole' ) and plot it for the full period of In in 
Figure 3.36, in order to compare it with the values of its DFT X(k), which always 
gives samples for 0 < < {N — 1), which corresponds to the full frequency 
range of [0 In]. The DFT X{k) are computed from the MATLAB function 
x=f ft (x, 64) . The absolute values of X{k) are plotted in Figure 3.37 showing 
that they match |Z(e''")|. 

Example 3.22 

In this example, we consider the same signal x(n) — [I 1 0.6 0.6] and 
h(n) — [I 0.6 0.4], which we considered in Example 3.17 and find the output 
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Figure 3.35 A discrete-time signal. 
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Magnitude of the Frequency Response 
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Normalized frequency in radians 
Figure 3.36 Magnitude response of the DTFT of a signal. 
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Figure 3.37 Magnitude of the DFT of a signal. 

y{n) of the discrete-time system using the FFT technique. The MATLAB program 
we use and the final output from the program are given below: 



x=[l 1 O.G 0.6]; 
h=[l 0.6 0.4]; 
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X=f ft (x, 8) ; 
H=f ft (h, 8) ; 
Y=X. *H; 
Y=if f t (Y, 8) 

The output is 



y = 1.0000 1.6000 1.6000 1.3600 0.6000 0.2400 0 0 



In this program, the MATLAB function y = ifft(Y,8) computes the 8-point 
IFFT of the product X{k)H(k) and the last line lists the output y(n), which is, 
not surprisingly, the same as the result of linear convolution x(n) * h(n). 



Example 3.23 

Let us consider the DFT samples of a lowpass filter response as given below 
and use the MATLAB function x = ifft(x,8) and plot the output x{n). The 
MATLAB program and the output x{n) are given below and the plot of x(n) is 
shown in Figure 3.38. Again note that the time index n in this figure runs from 
1 to 8, instead of from 0 to 7 in this 8-point IDFT: 



X=[l exp (-j*7*pi/8) 0 0 
x=if f t (X, 8) ; 
stem (x) 



0 0 0 exp(j*7*pi/8) ] ; 
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Figure 3.38 IDFT of a lowpass filter. 



SUMMARY 177 



title ('Values of the IDFT' ) 
ylabel ( 'Values of the IDFT') 
xlabel ( ' Index n' ) 



X 



The output is 

-0.1060 0.0293 0.2207 0.3560 0.3560 0.2207 0.0293 -0.1060 
3.9 SUMMARY 

We have discussed several topics in this chapter. First we showed that if a signal 
is bandlimited and we sample it at a frequency larger than twice the maximum 
frequency in the signal, we can use digital signal processing of the signal instead 
of analog signal processing, because the digital signal has all the information that 
is contained in the analog signal. Shannon's sampling theorem and the formula 
for reconstructing the analog signal from the samples was explained. When such 
an analog signal is sampled, the frequency response of the discrete-time signal 
is a continuous function of the digital frequency but is periodic with a period 
equal to the sampling frequency. Next we discussed several properties of the 
frequency response of the discrete-time signal (DTFT), illustrating them with 
numerical examples; they are summarized below: 

DTFT of a nonperiodic signal x(n): 



Then we considered a discrete-time signal that is periodic with a period A^. Its 
Fourier series representation was expressed in terms of its Fourier series coeffi- 
cients, and the formula for finding the values of the periodic discrete-time signal 
from the Fourier series coefficients was presented. Properties of the discrete-time 
Fourier series (DTFS) and the inverse DTFS were discussed and illustrated with 
examples. They are summarized as follows: 

DTFS of a periodic signal with period A^: 



oo 




(3.86) 



IDTFT of XieJ'^y. 




(3.87) 



N-l N-l 



Xp(n) = J2 X(k)ej^^''^'^'>''" = J2 ^('t)W 



—kn 



-oo < n < oo (3.88) 
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IDTFS of Xik) with period N: 

N-l , N-l 



Xpik) = ^J2 xin)e-j^^''^^^''" = ^ ^ x(n)\V*", -oo < fc < oo 

(3.89) 



The discrete Fourier transform (DFT) and its inverse (IDFT) are a subset of 
the DTFS and IDTFS coefficients, derived from the periodic DTFS and IDTFS 
coefficients. They can be considered as nonperiodic sequences. A few examples 
were worked out to show that the values of the DTFT, when evaluated at the 
discrete frequencies, are the same as the DFT coefficients: 

DFT of xin) with length N: 

N-l N-l 



Xik) = J2 xin)e-j^^''^''^'"' = J2 xin)W''", 0 < k < (N - I) 

(3.90) 



n=0 «=0 



IDFT of Xik) with length N: 

N-l , A'-l 



xin) = ^J2 ^We^'^^"^'^^^" = ^ I] Xik)W-''\ 0<n<iN-l) 

(3.91) 



N ^ N 

k=0 k=0 



The FFT algorithm for computing the DFT-IDFT coefficients offers very 
significant computational efficiency and hence is used extensively in signal pro- 
cessing, filter analysis, and design. It provides a unified computational approach to 
find the frequency response from the time domain and vice versa. More examples 
are added to show that the use of FFT and IFFT functions from MATLAB pro- 
vides a common framework for getting the frequency response of a discrete-time 
system from the discrete-time signal and finding the discrete-time signal from 
the frequency response. Remember that the terms discrete-time (digital) signal, 
sequence, ot function have been used interchangeably in this book; we have also 
used the terms discrete-time Fourier transform (DTFT), frequency response, and 
spectrum synonymously in this chapter. 



PROBLEMS 

3.1 A signal fit) = e~^-^'uit) is sampled to generate a DT signal fin) at such 
a high sampling rate that we can assume that there is no aliasing. Find a 
closed-form expression for the frequency response of the sequence fin). 

3.2 Find the Fourier transform Xijco) of the signal xit) = te~^-^'uit) and 
choose a frequency at which the attenuation is more than 60 dB. Assuming 
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'■|F(H| 

^ ^^^^ 

0 ft) ^ 

Figure 3.39 Problem 3.4 

that the signal is bandlimited by that frequency, what is the minimum sam- 
pling frequency one can choose to sample x(f) without losing too much 
information? 

3.3 A continuous-time function f{t) with a bandwidth of 200 Hz is sam- 
pled at 1000 Hz, and the sampled values are given by f{nT) — {1.0 

t 

0.4 0.1 0.001}. Find the value of /(r) at t = 0.005. 

3.4 A bandlimited analog signal /(f) has a Fourier transform F(jcL>) as shown 
in Figure 3.39. What is the maximum sampling period T that can be used 
to avoid aliasing in the frequency response F{e^") of the sampled sequence 
/(«)? Find the Fourier series coefficients for F{e''^). 

3.5 Find the DTFT oi x(n) — { — I 1 0 1 —1} and compute its value 

t 

at jo) = 70.47r. If the 10-point DFT Xj^ijoji^) of this x{n) is computed, 
what is the value of the index k at which the DFT is equal to X{e^^ '^'^)l 

3.6 Find the DTFT of a finite sequence {1.0 0.0 —1.0} and evaluate it at 

t 

(1) = 0.5n. Calculate the value of the DTFT ai a> — O.Stt, using the DFT 
for this sequence to verify this result. 

3.7 Find the DTFT of the following two functions: 

(a) xiin) = 10(0.5)" cos(0.27rn -|- f )«(«) 

(b) X2in) = n(0.2)«a(n) 

3.8 Find the DTFT of xi(n) = (0.5)"a(n) and X2(n) = (0.5)"; -5 < n < 5. 

3.9 Find the DTFT of the following sequences: 



xi(n) = 


u{n) — u(n — 6) 


xiin) = 


(0.5)" uin + 3) 


X3(n) = 


(0.5)"+^ a(n) 


X4(n) — 


(0.5)-"+2a(-« + 2) 


xs(n) = 


(0.3)"-2m(_„ + 2) 



180 



FREQUENCY-DOMAIN ANALYSIS 



3.10 Find the DTFT of the following two functions: 

(a) xi(n) = x(—n — 2) where xin) = e~^-^"u{n) 

(b) X2in) = 5-"M(n). 

3.11 Given the DTFT of = {1 0 -1 0}x as Xi{e}'^), express the 
DTFT of jC2(n) = {1 0-1010-1 0} in terms of ZiCe'"). 
Express the DTFT of X3(n) = {1 0 -1 1 0 -1 0 0} in terms 
ofXiieJ'^). 

3.12 An LTI-DT system is described by the difference equation 



Determine the value of b (other than 0.5) such that the square of the mag- 
nitude of its transfer function H{e^^) is a constant equal to for all 

frequencies. 

3.13 A comb filter is defined by its transfer function H{z) = (1 — z~'^)/N . 
Determine the frequency response of the filter in a closed-form expression 
for = 10. 

3.14 Show that the magnitude response of an IIR filter with 



is a real function of oj and an even function of cd. 

3.15 A discrete-time signal with a lowpass frequency response that is a con- 
stant equal to 5 and has a bandwidth equal to OAn is the input to an ideal 

bandpass filter with a passband between copi = O.Stt and a)p2 = 0.6n and 
a magnitude of 4. What is the bandwidth of the output signal? 

3.16 A DT signal x(n) = 4cos(0.4;rn) -|- 6 cos(0.87rn) -|- 10cos(0.9;Tn) is the 
input to an allpass filter with a constant magnitude of 5 for all frequencies. 
What is the output yin) of the filter? 

3.17 Given («) and h{n) = b"u(n), where 0<(3<1,0<^7<1, 
a^b show that y{n) = x(n) * h(n) = a"+' - b"'^^ /a - b. 

3.18 Find the DTFT of xin) = n^(0.l)"uin). 

3.19 Prove that 



y{n) — 0.5_y(n — 1) = x(n) — bx(n — 1) 



H(z) = 



2 + 0.2Z-1 - 0.2Z-3 - 2z-^ 
(1 - z-') 



N-l 




N k = 0, ±N, ±2N, . . . 
0 otherwise 
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3.20 Show that the frequency response of a sequence 



xin) = I Q 



1 -N <n <N 
otherwise 



is given by Z(e-'<") = 1 + 2J2^^^ cos(con) = sin(A^ + 0.5)cw/sin(0.5cw). 

3.21 Show that f^^ X{ej'^)dco = 2nx{0) where = E^o ^(«)^"-'"'"- 

3.22 Given H(ej'") and Z(e-''") as shown below, find the output yin) of the 
discrete-time system 



(1 - 0.6e-'") 

3.23 Given H{e-''") and as shown below, find the output y{n) 

1 



e}'^ + 0.3 



e 



7« 



(1 + 0.5e-j'")il - 0.5e>) 
3.24 Find the IDTFT of the function given below: 

1 _ e-j2<w 

Y{en = 



(1 + 0.2e-"")(l - 0.4e--'»)(e-"" + 0.5) 
3.25 Find the IDTFT of the function given below: 



(eJ'^ + 0.1)(1 - e-J'^)il + e^<") 

3.26 If the input of an LTI-DT system is x{n) = (0.2)"m(— n) and its unit pulse 
response h{n) is {OA)"u(n), what is its output yin)1 

3.27 Given an input x(n) = (0.2)~" u(—n) + (0.5)" u(n) and the unit impulse 
response of an LTl-DT system as (OA)"u{n), find its output y(n). 

3.28 Given a sequence xi{n) = (03)^"u{—n) and another sequence X2(n) = 
(0.6)"m(— n), find their convolution sum xi{n) * X2in), using their DTFT. 

3.29 Find the convolution y{n) = x\ (n) * X2in) where xi (n) = 0.5~"m(— «) and 
X2in) = (0.2)-«M(-n). 

3.30 Find the DTFT of Xe(n) and xo(n) where x(n) = (0.4)"u(n), and Xe(n) = 
[xin) + x(—n)]/2 is the even part of x{n) and xo(«) = [x{n) — x{—n)]/2 
is the odd part of x{n). 
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3.31 Find the IDTFT of 

Fie'"') = e^™/[(l - OAe-J''^){l + 0.4e"^'")(l + 0.4e^'")]. 

3.32 Find the IDTFT of X(e>") = 3e>^'"/(e^" - 0.4). 

3.33 Find the IDTFT of 

(a) = cos2(4«) 

1 for (Del £ ft) < <^c2 
0 otherwise 



(b) X{en 



3.34 Find the IDTFT of Xiej'"} = 1 + 4cos(w) + 3 cos(5w). 

3.35 Find the IDTFT of the two functions given below: 

(a) Hi (e^") =1 + 2 cos(a.) + 4 cos(2«) 

(b) Hiiej"") = 1 + 2cos(w) + 4cos2(2w) 

Find the IDTFT of Hi (e-'™) =1 + 4 cos(ft;) + 3 cos(5ftj) cos(<y). 

Find the IDTFT of the following two functions: 

(a) Yiiej'^) = sin(ft;)[4 + 4cos(«) + 2cos^{cl>)] 

(b) F2(e^'") = ye"^'*'"''2'[4 + 2cos(ft;)+4cos2(«)]sin(ft;/2) 

Find the IDTFT of H2(e'") shown in Figure 3.40. Find the Fourier series 
coefficients of the periodic function H2{e^"). 

An FIR filter is defined by Hiz'^) = 1 + O.Sz"' + 0.4z-2 + OAz~^. Find 
the magnitude of its frequency response at ca — 0.8jr, using the DFT 
formula. 

3.40 ComputetheDFTZ8(3)andXi6(6)ofthesequencejc(n) = {1.0 0.3 0.2 



3.36 
3.37 



3.38 
3.39 



0.5}. 



t 



3.41 A discrete-time sequence x(n) — {I 1 1 1 1 1} is sampled at 

t 

2400 Hz, and the magnitude of its DTFT at 600 Hz is known to be V2. 



' |Hz(e* 



1.0 



0.05 



O.Itt 0.2ff 



O.Gti 



Figure 3.40 Problem 3.38. 
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What is the magnitude at 6600 Hz? Compute the sample ^8(2) of its 
8-point DPT. 

3.42 Given the 6-point DFT of f{n), as given below compute the value of /(3): 

F(0) = 10.0; = -3.5 - j2.6; F{2) = -2.5 - yO.866 
F(3) = -2.0; F(4) = -2.5 + 7O.866; F(5) = -3.5 + 72.6 

3.43 Compute the 6-point IDFT of X{k) given below: 

X(k) = {3 + jO -l + jO -0 + ;1.732 5 + jO 0-;1.732 
- 1 - jO] 

3.44 If the A^-point DFT of a real sequence x{n) is X^ik), prove that the 
DFT of x((—n))N is X'^(k), using the property x{{—n))N — X(N — n). 
Show that the DFT of the even part Xe{n) = {x(n) + x(— n)]/2 is given by 
ReZ(fe) and the DFT of the odd part Xo{n) = [x{n) — x{—n)\/2 is given 
by jlmX{k). 

3.45 Find the even part and odd part of the following functions: 
xi(«) = {l -12 0 11} 

X2{n) = {\ 2 1-10-201} 
X3(«) = {1 1 -1 3} 
X4(n) = {0 12-110} 

3.46 Determine which of the following functions have real-valued DFT and 

which have imaginary-valued DFT: 

xi(n) = {l 0.5 1 0 0 1 0.5) 

X2{n) = {\ 0.5 -110 1-1 0.5} 

X3(«) = {0 0.5 -110-11 -0.5} 

XA{n) = {\ 2 0 0 1 0 0 -2} 

3.47 Compute the 4-point DFT and 8-point DFT of = {1 0.5 -1.5}. 

Plot their magnitudes and compare their values. 

3.48 Calculate the 5-point DFT of the x{n) ^ { \ 0.5 - 1.5} above. 

3.49 Calculate the 6-point DFT of x(n) = {1 1 0.5 0 -0.5}. 

3.50 Given the following samples of the 8-point DFT 

Z(l) = 1.7071 - J 1.5858 
X(3) = 0.2929 -I- J4.4142 
X(6) = -0 + y2 
find the values of Z(2), Z(5), and Z(7). 

3.51 Given the values of Z (4) , Z ( 1 3) , X ( 1 7) , X (65) , X (8 1 ) , and Z (90) of an 
128-point DFT function, what are the values of Z(124), Z(63), Z(115), 
Z(38), Z(lll), and Z(47)? 
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MATLAB Problems 

3.52 Compute the 16-point and 32-point DFTs of the 4-point sequence x(n) = 
{1 0.5 0 —0.5}. Plot their magnitudes and compare them. 

3.53 Compute the 24-point DFT of the sequence in Problem 3.52, plot the 
magnitude of this DFT. Now compute 24-point IDFT of this DFT and 
compare it with x(n) given above. 

3.54 Plot the magnitude of the following transfer functions: 



1 + 0.2Z-1 + 0.4Z-2 + z-3 - z-4 + 0.06Z-5 

z-^ - O.Sz-^ + z"' - 6 

1 + z-i + 0.8Z-2 - 0.4z-3 - 0.3Z-4 + z-5 + 0.05Z-6 

(l-0.3z)(l + 0.2z + z2) 

(z2 + 0.2z + 1.0)(z2 - O.lz + 0.05)(z - 0.3) 



z z + 0.5 0.8 

^^^'^ - ?Ta4 " (z + 0.1)2 + T 

3.55 Plot the magnitude and phase responses of the following functions: 

0.2e^'" + 0.9e-''2'» 



H,{en = 



1 - O.ee-''" + 0.6e-'2'» - 0.5e-'3® + ei^ 
1 + 0.4e--''" 

1 + 0.5e--''*' - 0.4e--'2" + g-./s® + 0.3e--'4" + O.lg--'^'" 
H^ien = HiienH2(en 

3.56 Evaluate the magnitude response of the transfer function H(z) at o) = 
0.3657r and at o) = 0.635;r: 



1 - O.Sz-i + 0.4Z-2 - 0.05Z-3 



3.57 From the real sequence jc(n) = {1 —1 2 0.5 0 —1 2 1}, show 
that the DFT of [ Xein)] = ReX{k) where the even part Xein) = [x(«) + 
x((-n))^]/2. 

3.58 From the real sequence in Problem 3.57, obtain its odd part and show that 
its DFT = jlmXik). 
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CHAPTER 4 



Infinite Impulse Response Filters 



4.1 INTRODUCTION 

In Chapter 2, we discussed the analysis of discrete-time systems to obtain their 
output due to a given input sequence in the time domain, using recursive algo- 
rithm, convolution, and the z-transform technique. In Chapter 3, we introduced 
the concept of their response in the frequency domain, by deriving the DTFT or 
the frequency response of the system. These two chapters and Chapter 1 were 
devoted to the analysis of DT systems. Now we discuss the synthesis of these 
systems, when their transfer functions or their equivalent models are given. If we 
are given the input-output sequence, it is easy to find the transfer function H{z) 
as the ratio of the z transform of the output to the z transform of the input. If, 
however, the frequency response of the system is specified, in the form of a plot, 
such as when the passband and stopband frequencies along with the magnitude 
and phase over these bands, and the tolerances allowed for these specifications, 
are specified, finding the transfer function from such specifications is based on 
approximation theory. There are many well-known methods for finding the trans- 
fer functions that approximate the specifications given in the frequency domain. 
In this chapter, we will discuss a few methods for the design of IIR filters that 
approximate the magnitude response specifications for lowpass, highpass, band- 
pass, and bandstop filters. Usually the specifications for a digital filter are given 
in terms of normalized frequencies. Also, in many applications, the specifications 
for an analog filter are realized by a digital filter in the combination of an ADC in 
the front end with a DAC at the receiving end, and these specifications will be in 
the analog domain. The magnitude response of ideal, classical analog filters are 
shown in Figure 4.1. Several examples of IIR filter design are also included in 
this chapter, to illustrate the design of these filters and also filters with arbitrary 
magnitude response, by use of MATLAB functions. The design of FIR filters that 
approximate the specifications in the frequency domain is discussed in the next 
chapter. 
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Figure 4.1 Magnitude responses of analog filters: (a) lowpass filter; (b) highpass filter; 
(c) bandpass filter; (d) bandstop filter. 



Let us select any one of the following methods to specify the IIR filters. The 
recursive algorithm is given by 



N 



M 



y{n) = - ^aik)yin - k) + ^b{k)xin - k) (4.1) 



and its equivalent form is a linear difference equation: 

N M 



^a(k)y(n-k) = ^bik)x(n-ky, a(0) = 1 



k=0 k=0 

The transfer function of the IIR filter is given by 



EkUHk)z- 



fl(0) = 1 



(4.2) 



(4.3) 
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Let US consider a few properties of the transfer function when it is evaluated on 
the unit circle z = e-'®, where co is the normalized frequency in radians: 



Hk) cos(M - j EkU b(k) sinikay) 



M 



= \Hiej'")\ej^'-'^^ 



(4.4) 



In this equation, H{e'") is the frequency response, or the discrete-time Fourier 
transform (DTFT) of the filter, [//(e''")] is the magnitude response, and 9(ej") 
is the phase response. If Z(e-'") = |Z(e-''")| e^"'-'"^ is the frequency response of 
the input signal, where |Z(e-''")| is its magnitude and aijco) is its phase response, 
then the frequency response Y(e''") is given by Y{e'^) — X(e''")H(e'") = 
|Z(e-''")| |if(e^"')| e7(«(®)+<'0«)). Therefore the magnitude of the output signal 
is multiplied by the magnitude |//(e-''")| and its phase is increased by the phase 
eieJ"') of the filter: 



\H(eJ'") 



[Eto Kk) cos(to)]' + [Zto bik) sinikco)]^ 
[Ef=o aik) cos(m]' + [Zto^ik) sin(to)]' 



1/2 



0(ja>) = — tan 



1 Ek=ob{k)smik(o) , Er=o«(fe)sin(M 

EitLo^W cos (to) 



The magnitude squared function is 



-l-tan' 



(4.5) 



(4.6) 



\H(ej'^)\ = \Hiej'^}Hie-j'^)\ = \Hie}'^)H*(e}'^)\ 



(4.7) 



where H*(e^'") = H(e^^") is the complex conjugate of H{e-'"). It can be shown 
that the magnitude response is an even function of co while the phase response 
is an odd function of co. 

Very often it is convenient to compute and plot the log magnitude of \H(e^''^) | 

as 10 log \H(ej'^)\^ measured in decibels. Also we note that H{ej'^)/H{e~^"') = 
gi20{oS) _ -pjjg group delay x{jco) is defined as T(ycw) = —[d0{jco)]/dco and is 
computed from 



rico) = 



1 du 



1 dv 



l+u?- dco 1 + dco 



where 



TLobik) sin(M 



u = 



Tf=ob{k) cos(M 



(4.8) 



(4.9) 



MAGNITUDE APPROXIMATION OF ANALOG FILTERS 189 



11k=o^(^) cos (to) 

Designing an IIR filter usually means that we find a transfer function H(z) 
in the form of (4.3) such that its magnitude response (or the phase response, the 
group delay, or both the magnitude and group delay) approximates the specified 
magnitude response in terms of a certain criterion. For example, we may want 
to amplify the input signal by a constant without any delay or with a constant 
amount of delay. But it is easy to see that the magnitude response of a filter or 
the delay is not a constant in general and that they can be approximated only by 
the transfer function of the filter. In the design of digital filters (and also in the 
design of analog filters), three approximation criteria are commonly used: (1) the 
Butterworth approximation, (2) the minimax (equiripple or Chebyshev) approxi- 
mation, and (3) the least-pth approximation or the least-squares approximation. 
We will discuss them in this chapter in the same order as listed here. Designing a 
digital filter also means that we obtain a circuit realization or the algorithm that 
describes its performance in the time domain. This is discussed in Chapter 6. It 
also means the design of the filter is implemented by different types of hardware, 
and this is discussed in Chapters 7 and 8. 

Two analytical methods are commonly used for the design of IIR digital fil- 
ters, and they depend significantly on the approximation theory for the design 
of continuous-time filters, which are also called analog filters. Therefore, it is 
essential that we review the theory of magnitude approximation for analog filters 
before discussing the design of IIR digital filters. 



4.2 MAGNITUDE APPROXIMATION OF ANALOG FILTERS 

The transfer function of an analog filter H(s) is a rational function of the complex 
frequency variable s, with real coefficients and is of the form^ 

rj, . C0 + CIS + C2S^ + ■■■+ c^s"" 

H{s) = T , m<n (4.11) 

do + dis + d2S^ -!-■■■ + d„s" 

The frequency response or the Fourier transform of the filter is obtained as a 
function of the frequency cw,^ by evaluating H{s) as a function of jw 

„ , . . C0 + jClCO - C2(W^ - jCsCo'^ + C4C0'^ H 1- ij)'"CmC0'" 

^^J^^ = ^ , 1—2 3 . ^ 4 . TT^ n 

"0 + jdico — d2C0^ — jdsco^ + d^co^ H -|- {j)"CnCo" 

= \H{jco)\ei1'^''^ (4.13) 

'Much of the material contained in Sections 4.2-4.10 has been adapted from the author's book 
Magnitude and Delay Approximation of 1-D and 2-D Digital Filters and is included with permission 
from its publisher. Springer- Verlag. 

'In Sections 4.2-4.8, discussing the theory of analog filters, we use oi and Q. to denote the angular 
frequency in radians per second. The notation a> should not be considered as the normalized digital 
frequency used in H(e^"'). 
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where H{jco) is the frequency response, \H{jco)\ is the magnitude response, and 
6{jco) is the phase response. We also find the magnitude squared and the phase 
response from the following: 

\H{j(o)\^ = H{jco)H{-jco) = Hijco)H*Uco) (4.14) 



H(-jco) 



= e^^"^™' (4.15) 



The magnitude response of an analog filter is an even function of a>, whereas 
the phase response is an odd function. Although these properties of Hijco) are 
similar to those of H(e->'^), there are some differences. For example, the frequency 
variable o) in H(jco) is (are) in radians per second, whereas to in H{e^'") is 
the normalized frequency in radians. The magnitude response |//(jft;)| (and the 
phase response) is (are) aperiodic in co over the doubly infinite interval — oo < 
CD < oo, whereas the magnitude response |/f(e^")| (and the phase response) is 
(are) periodic with a period of In on the normalized frequency scale. 

Example 4. 1 

Let us take a simple example of a transfer function of an analog function as 

^ + 1 

His) = (4.16) 
s'^ + 2s + 2 

The first step is to multiply H{s) with H(—s) and evaluate the product at 

s = jco: 

[His)Hi-s)]l^j„ = \H{jco)\' (4.17) 
|/f(»|2 = [H{s)H{-s)}\,^j^ = {^^±i2^Zj±iL^^l| (4.18) 



0)4+1 



(4.19) 



From this example, we see that to find the transfer function H(s) in (4.16) from 

the magnitude squared function in (4.19), we reverse the steps followed above in 
deriving the function (4.19) from the H{s). In other words, we substitute jco = 
s (or (o^ = —s^) in the given magnitude squared function to get H{s)H{—s) 
and factorize its numerator and denominator. For every pole at (and zero) 
in H{s), there is a pole at —Sk (and zero) in H{—s). So for every pole in 
the left half of the s plane, there is a pole in the right half of the s plane, 
and it follows that a pair of complex conjugate poles in the left half of the s 
plane appear with a pair of complex conjugate poles in the right half-plane also, 
thereby displaying a quadrantal symmetry. Therefore, when we have factorized 
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the product H(s)H{—s), we pick all its poles that lie in the left half of the 
i-plane and identify them as the poles of H{s), leaving their mirror images in 
the right half of the .s-plane as the poles of H{—s). This assures us that the 
transfer function is a stable function. Similarly, we choose the zeros in the left 
half-plane as the zeros of H{s), but we are free to choose the zeros in the 
right half-plane as the zeros of H(s) without affecting the magnitude. It does 
change the phase response of H(s), giving a non-minimum phase response. 
Consider a simple example: F] (s) — (s + 1) and F2{s) — (s — 1). Then F22{s) — 
{s + l)[(s — l)/(s + I)] has the same magnitude as the function ^2(5) since 
the magnitude of (s — l)/is + 1) is equal to Kjco — l)/(ja> + 1)| = 1 for all 
frequencies. But the phase of F22(Jco) has increased by the phase response of 
the allpass function (i — l)/(i+l). Hence F22(s) is a non-minimum phase 
function. In general any function that has all its zeros inside the unit circle in the 
z plane is defined as a minimum phase function. If it has atleast one zero outside 
the unit circle, it becomes a non-minimum phase function. 

4.2.1 Maximally Flat and Butterworth Approximation 

Let us choose the magnitude response of an ideal lowpass filter as shown in 
Figure 4.1a. This ideal lowpass filter passes all frequencies of the input continuous- 
time signal in the interval \ci)\ < cdc with equal gain and completely filters out all 
the frequencies outside this interval. In the bandpass filter response shown in 
Figure 4.1c, the frequencies between coi and 012 and between —a>i and —0)2 only 
are transmitted and all other frequencies are completely filtered out. 

In Figure 4.1, for the ideal lowpass filter, the magnitude response in the 
interval 0 < co < coc is shown as a constant value normalized to one and is 
zero over the interval coc < a> < 00. Since the magnitude response is an even 
function, we know the magnitude response for the interval —00 < m < 0. For 
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Figure 4.2 Magnitude response of an ideal lowpass analog filter showing the tolerances. 
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the lowpass filter, the frequency interval 0 < co < coc is called the passband, 
and the interval cwc < cw < oo is called the stopband. Since a transfer function 
H{s) of the form (4.11) cannot provide such an ideal magnitude characteristic, it 
is common practice to prescribe tolerances within which these specifications 
have to be met by \H{jo))\. For example, the tolerance of 8p on the ideal 
magnitude of one in the passband and a tolerance of <5v on the magnitude of 
zero in the stopband are shown in Figure 4.2. A tolerance between the pass- 
band and the stopband is also provided by a transition band shown in this 
figure. This is typical of the magnitude response specifications for an ideal fil- 
ter. 

Since the magnitude squared function \H{jo})\ = H(jco)H(—jco) is an even 
function in a), its numerator and denominator contain only even-degree terms; 
that is, it is of the form 

,,2 Co + C26;2 + C4C0' + ... + C2,„co2>n 

//(/ft)) = — (4.20) 

In order that it approximates the magnitude of the ideal lowpass filter, let us 
impose the following conditions 

1. The magnitude at a; = 0 is normalized to one. 

2. The magnitude monotonically decreases from this value to zero as ft) -> oo. 

3. The maximum number of its derivatives evaluated at ft) = 0 are zero. 

Condition 1 is satisfied when Cq = 1, and condition 2 is satisfied when the coeffi- 
cients C2 — C/\ — ■ ■ ■ = C2m = 0. Condition 3 is satisfied when the denominator 
is 1 -I- £)2„ft>^", in addition to condition 2 being satisfied. The magnitude response 
that satisfies conditions 2 and 3 is known as the Butterworth response, whereas 
the response that satisfies only condition 3 is known as the maximally flat mag- 
nitude response, which may not be monotonically decreasing. The magnitude 
squared function satisfying the three conditions is therefore of the form 



l^^^''^^!' = 1 ^ n 2n ^4.21) 

We scale the frequency ft) by (Dp and define the normalized analog frequency 
Q, = ci)/a)p so that the passband of this filter is Qp = I. Now the magnitude of 
the lowpass filter satisfies the three conditions listed above and also the condition 
that its passband be normalized to ^p = I. Such a filter is called a prototype 
lowpass Butterworth filter having a transfer function H(p) = H(s/p), which 
has its magnitude squared function given by 

The following specifications are normally given for a lowpass Butterworth filter: 
(1) a magnitude of Hq at co = 0, (2) the bandwidth cop, (3) the magnitude at the 



1 
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bandwidth ojp, (4) a stopband frequency (Os, and (5) the magnitude of the filter 
at (Ds . The transfer function of the analog filter with practical specifications like 
these will be denoted by H{p) in the following discussion, and the prototype 
lowpass filter will be denoted by H{s). 

Before we proceed with the analytical design procedure, we normalize the 
magnitude of the filter by Hq for convenience and scale the frequencies Mp and 
cOs by cOp so that the bandwidth of the prototype filter and its stopband fre- 
quency become Q.p = \ and = cOs/op, respectively. The specifications about 
the magnitude at f2p and Q.s are satisfied by the proper choice of D2n and n 
in the function (4.22) as explained below. If, for example, the magnitude at the 
passband frequency is required to be 1 /'Jl, which means that the log magnitude 
required is —3 dB, then we choose D2„ = 1. If the magnitude at the passband 
frequency f2 = ^2^ = 1 is required to be 1 — 5p, then we choose D2„, normally 
denoted by e^, such that 



If the magnitude at the bandwidth f2 = = 1 is given as —Ap decibels, the 
value of is computed by 

101og(l + e2) = Ap 

log(l + e2) = 0.1Ap 
(1 + e^) = \Qp.\Ap 



From the last equation, we get the formulae^ — lO"''*'' — landc = 10"''^'' — 1. 

Let us consider the common case of a Butterworth filter with a log magnitude 
of —3 dB at the bandwidth of Q.p to develop the design procedure for a Butter- 
worth lowpass filter. In this case, we use the function for the prototype filter, in 
the form 

This satisfies the following properties: 

1. The magnitude squared of the filter response at S2 = 0 is one. 

2. The magnitude squared at S2 = 1 is | for all integer values of n; so the log 
magnitude is —3 dB. 

3. The magnitude decreases monotonically to zero as ^2 ^ oo; the asymptotic 
rate is — 40n dB/decade. 
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1.2 




Frequency in rad/sec 



Figure 4.3 Magnitude responses of Butterworth lowpass filters. 

The magnitude response of Buttei^oilh lowpass filters is shown for n = 
2, 3, . . . , 6 in Figure 4.3. Instead of showing the log magnitude of these filters, 
we show their attenuation in decibels in Figure 4.4. Attenuation or loss measured 
in decibels is defined as 

-lOlog = 101og(l + Q^") 

The attenuation over the passband only is shown in Figure 4.4a, and the maximum 
attenuation in the passband is 3 dB for all n; the attenuation characteristic of the 
filters over 1 < f2 < 10 for n = 1, 2, . . . , 10 is shown in Figure 4.4b. 

4.2.2 Design Theory of Butterworth Lowpass Filters 

Let us consider the design of a Butterworth lowpass filter for which (1) the 
frequency cOp at which the magnitude is 3 dB below the maximum value atco — 0, 
and (2) the magnitude at another frequency (Wj in the stopband are specified. 
When we normalize the gain constant to unity and normalize the frequency by 
the scale factor ojp, we get the cutoff frequency of the normalized prototype 
filter — 1 and the stopband frequency ^2., — aijcop. After we have found the 
transfer function H{p) of this normalized prototype lowpass filter, we restore 
the frequency scale and the magnitude scale to get the transfer function H(s) 
approximating the prescribed magnitude specification of the lowpass filter. 

The analytical procedure used to derive H{p) from the magnitude squared 
function of the prototype lowpass filter is carried out simply by reversing the 
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Steps used to derive the magnitude squared function from H{p) as illustrated by 
Example 4.1 earlier. First we substitute S2 = p/j or equivalently = —p^ in 
(4.24): 



1 



1 + S22n 



^ = H{p)H{-p) (4.25) 



n n2n 



The denominator has 2n zeros obtained by solving the equation 



1 + i-Tp^" = 0 (4.26) 



or the equation 

,2n 



1 = e^2te „ 

even 



P'" = \ .i=,;(2.+i). (4.27) 



This gives us the 2n poles of H{p)H(—p), which are 

p^ = e7(2te/2n);r k=l,2,..., (In) when n is odd (4.28) 

and 

p^ = emk-i)/2n]7t k=l,2,..., (2w) when n is even (4.29) 
or in general 

p^ = e7K2'=+«-i)/2«J^ yt = 1, 2, . . . , (2n) (4.30) 

We notice that in both cases, the poles have a magnitude of one and the angle 
between any two adjacent poles as we go around the unit circle is equal io n/n. 
There are n poles in the left half of the p plane and n poles in the right half of 
the p plane, as illustrated for the cases of n = 2 and n = 3 in Figure 4.5. For 
every pole of H{p) at p = pa that Ues in the left half-plane, there is a pole of 
H{—p) at p = —pa that Ues in the right half-plane. Because of this property, 
we identify n poles that are in the left half of the p plane as the poles of H{p) 
so that it is a stable transfer function; the poles that are in the right half-plane 
are assigned as the poles of H{—p). The n poles that are in the left half of the 
p plane are given by 



Pk = exp 



2A; -I- n - 1 



A:= 1,2,3, (4.31) 



When we have found these n poles, we construct the denominator polynomial 
D(p) of the prototype filter H{p) = from 

n 

D{p) = Y[{p - Pk) (4.32) 
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n = 2 n = 3 



Figure 4.5 Pole locations of Butterworth lowpass filters of orders n = 2 and w = 3. 

The only unknown parameter at this stage of design is the order n of the filter 
function H(p), which is required in (4.31). This is calculated using the specifi- 
cation that at the stopband frequency Qs, the log magnitude is required to be no 
more than — A, dB or the minimum attenuation in the stopband to be As dB. 

lOlog \HU^s)\^ = -lOlogd + ^f) < -As (4.33) 

from which we derive the formula for calculating n as follows: 

log(100 i'*^ - 1) 

n > — (4.34) 

21og^2, 

Since we require that n be an integer, we choose the actual value of n = [n~\ 
that is the next-higher integer value or the ceiling of n obtained from the right 
side of (4.34). When we choose n — [«! , the attenuation in the stopband is more 
than the specified value of As. We use this integer value for n in (4.31), to cal- 
culate the poles and then construct the denominator polynomial D(p) of order 
n. By multiplying {p — pk) with {p — p'^) where pi^ and p^ are complex con- 
jugate pairs, the polynomial is reduced to the normal form with real coefficients 
only. These polynomials, known as Butterworth polynomials, have many special 
properties. In the polynomial form, if we represent them as 

Dip) ^ I + dip + d2p'^ + ■ ■ ■ + dnp" (4.35) 



their coefficients can be computed recursively from {dQ= 1) 

= vkn^ dk-i 1,2,3,..., n (4.36) 

But there is no need to do so, since they can be computed from (4.32). They are 
also listed in many books for n up to 10 in polynomial form and in some books 
in a factored form also [3,2]. We list a few of them in Table 4.1. 
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TABLE 4.1 



n Butterwoith Polynomial D(p) in Polynomial and Factored Form 



1 p+1 

2 + V2p + 1 

3 p^+2p^ + 2p+l = ip+l)(p^ + p+l) 

4 / + 2.61326/j3 + 3.41421p2 + 2.61326p + 1 

= (p^ + 0.76537p + l)(p2 + 1.84776p + 1) 

5 p^ + 3.23607^"* + 5.23607/7^ + 5.23607^^ + 3.23607p + 1 

= ip + + 0.618034p + l)ip^ + 1.931804p + 1) 

6 p^ + 3.8637p5 + 7.4641 p* + 9.1416/?^ + 7.4641 + 3M31p + 1 

= (p2 + 0.5176/7 + l)(p2 + l.4142p + l)(p2 + l.9318p + 1) 



In the case of lowpass filters, usually the magnitude is specified at o) = 0; 
hence it is also the magnitude at S2 = 0. Therefore the specified magnitude is 
equated to the value of the transfer function H(p) evaluated at p — jO. This is 
equal to H{jO) = Ho/D{jO) = Hq. So we restore the magnitude scale by mul- 
tiplying the normalized prototype filter function by Hq. To restore the frequency 
scale by cOp, we put p = sjojp in Hq/D{p) and simplify the expression to get 
transfer function H{s) for the specified lowpass filter. This completes the design 
procedure, which will be illustrated in Example 4.2. 

Example 4.2 

Design a lowpass Butterworth filter with a maximum gain of 5 dB and a cutoff 
frequency of 1000 rad/s at which the gain is at least 2 dB and a stopband fre- 
quency of 5000 rad/s at which the magnitude is required to be less than —25 dB. 

The maximum gain of 5 dB is the magnitude of the filter function at « = 0. 
The edge of the passband is the cutoff frequency Wp = 1000, and the frequency 
range Q < o) < cop is called the bandwidth. So we see that the magnitude of 
2 dB at this frequency is 3 dB below the maximum value in the passband. We 
say that the filter has a 3 dB bandwidth equal to 1000 rad/s. The frequency scale 
factor is chosen as 1000 so that the passband of the prototype filter is = 1. 
The stopband frequency cl>s is specified as 5000 rad/s and is therefore scaled to 
Q.S = 5. The magnitude is normalized so that the normalized prototype lowpass 
filter function H{p)^ has a magnitude of one (i.e., 0 dB) atQ = 0. It is this filter 
that has a magnitude squared function 

'Note that wc have chosen p = J2+j^ '^^ the notation for the complex frequency variable of the 
transfer function H(p) for the lowpass prototype filter and the notation s = a + j(o for the variable 
of the transfer function H(s) for the specified filter. 
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Figure 4.6 Magnitude response specifications of prototype filters: (a) Butterwortii filter; 
(b) Chebyshev (equiripple) filter. 



It is always necessary to reduce the given specifications to the specifications of 
this normalized prototype filter to which only the expressions derived above are 
applicable. The magnitude response of the normalized prototype filter (not to 
scale) for this example is shown in Figure 4.6a. 

For this example, note that the maximum attenuation in the passband is Ap — 
3 dB and the minimum attenuation in the stopband is Aj = 30 dB. From (4.34) 
we calculate the value of n = 2.1457 and choose n — [2.1457] — 3. From (4.31), 
we get the three poles as pi — —0.5 + y VO.75, p2 — — ^-0 and — —0.5 — 
7'\/0.75. Therefore the third-order denominator polynomial D{p) is obtained 
from (4.32) or from Table 4.1: 



Dip) ^{p + 0.5 - jV0J5){p + l)(p + 0.5 + yOJ5) 

^(p^ + p+ l){p +1)^ + 2p^ + 2p+l (4.38) 

Hence the transfer function of the normalized prototype filter of third order is 

Hip) = ^1 (4.39) 

p^ + 2p^ + 2p+l 

To restore the magnitude scale, we multiply this function by Hq. Now the filter 
function is 

Hip) = f" ^. (4.40) 

p^ + 2p^ + 2p+l 



which has a magnitude of Hq ai p — jO. From the requirement 201og(ifo) — 
5 dB, we calculate the value of Hq — 1.7783. To restore the frequency scale, we 
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substitute p — s/lOQO in (4.40) and simplify to get H{s) as shown below: 

1.7783 



H{p)\ 



p=V1000 = . ^ ^3 / .V \2 ( S \ 

V 1000/ \ 1000/ vTooo/ 

_ (1.7783)10'* 

~ ^3 + (2 X 10^)^2 + (2 X \0^)s + 10'' 

= H{s) 



(4.41) 
(4.42) 



The magnitude of H{p) plotted on the normalized frequency scale Q, shown in 
Figure 4.7 is marked as "Example (2)." It is found that the attenuation at the 
stopband edge Q.^ = 5 is about 42 dB, which is more than the specified 30 dB. 

It must be remembered that in (4.37) Q.p = 1 is the bandwidth of the prototype 
filter, and at this frequency, \H{jQ)\^ has a value of ^ or a magnitude of —3 dB. 
Hence formulas (4.31) and (4.34) cannot be used if the maximum attenuation Ap 
in the passband is different from 3 dB. In this case, we modify the function to 
the form (4.43), which is the general case: 



1 



1 + 62^2 2« 



Now the attenuation at ^2 = 1 is given by 101og(l + e^) 



get = (10' 



,0.1A„ 



(4.43) 



Ap, from which we 



1). We may also note that e — Im the previous case when 



Ap — 3. When Ap is other than 3 dB, the formulas for calculating n and pk are 



n > 



log [(10' 



,0.1/1, 



1)/(10' 



,0.1A„ 



D] 



2 log 



{AM) 



T3 
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1 \ \ \ 



10° 

Frequency in radians/sec-linear scale 
Figure 4.7 Magnitude responses of the prototype filters in Examples 4.1-4.3. 
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and 



Pk 



exp J 



2k + n-\ 
In 



) 



71 



k = 



1,2,3, 



(4.45) 



Comparing (4.45) with (4.31), it is obvious that the poles have been scaled by a 
factor So the maximum attenuation at = I is the specified value of 

Ap-, also the frequency at which the attenuation is 3 dB is equal to e~(i/n). 

Example 4.3 

Design a lowpass Butterworth filter with a maximum magnitude of 5 dB, pass- 
band of 1000 rad/s, maximum attenuation in the passband Ap = 0.5 dB, and 
minimum attenuation Ag = 30 dB at the stopband frequency of 5000 rad/s. 

First we scale the frequency by tOp = 1000 so that the normalized passband 
frequency Qp = I and the stopband frequency cos is mapped to Qs = 5. Also 
the magnitude is scaled by 5 dB. The magnitude response for the normalized 
prototype filter H(p) is similar to that shown in Figure 4.6a, except that now 
Ap = 0.5 dB. Then we calculate = (IO^-^^p - 1) = 0.1220 and therefore e = 
0.3493. From (4.44), the value of n = 2.7993; it is rounded to [n] =3. Next we 
compute the three poles from (4.45) as pi = -0.71 + 71.2297, p2 = -1.4199, 
and p3 = —0.71 — 7 1.2297. The transfer function of the filter with these poles is 



Since the maximum value has been normalized to 0 dB, which occurs at S2 = 0, 
we equate the magnitude of H(p) evaluated at /> = j'O to one. Therefore Hq = 
(1.4199)(2.0163) = 2.8629 To raise the magnitude level to 5 dB, we have to 
multiply this constant by -s/To^ = 1.7783. Of course, we can compute the same 
value for Hq in one step, from the specification 20 log \ H{jO)\ = 20 log H(0) — 
201og(1.4199)(2.0163) = 5. The frequency scale is restored by putting p = 
j/1000 in (4.46) to get (4.47) as the transfer function of the filter that meets 
the given specifications: 



Hip) = 



(p + 1.4199)(/7 + 0.71 - jl.2297){p + 0.71 + ;1.2297) 
Ho 



(p + 1.4199)(p2 + iA2p + 2.0163) 



(4.46) 



H{s) = 



(2.8629)(1.7783) 



[5/1000+ 1.4199][(5/1000)2 + 1.42(5/1000) + 2.0163] 
5.09 X 10** 



[s + 1419.9][i2 + 14205 + 2.0163 x 10^] 



(4.47) 



The plot is marked as "Example (3)" in Figure 4.7. It is the magnitude response 
of the prototype filter given by (4.46). It has a magnitude of —0.5 dB at ^2 = 1 
and approximately —33 dB at S2 = 5, which exceeds the specified value. 
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4.2.3 Chebyshev I Approximation 

The Chebyshev I approximation for an ideal lowpass fiUer shows a magnitude 
that has the same values for the maxima and for the minima in the passband and 
decreases monotonically as the frequency increases above the cutoff frequency. 
It has equal- valued ripples in the passband between the maximum and minimum 
values as shown in Figure 4.6b. Hence it is known as the minimax approximation 
and also as the equiripple approximation. To approximate the ideal magnitude 
response of the lowpass filter in the equiripple sense, the magnitude squared 
function of its prototype is chosen to be 

\HijQ)\^= (4.48) 

where C„(f2) is the Chebyshev polynomial of degree n. It is defined by 

C„(S2) = cos(n cos"^ ^) (4.49) 

The polynomial C„(f2) approximates a value of zero over the closed interval 
^2 e [— 1, 1] in the equiripple sense as shown by examples for n = 2, 3, 4, 5 
in Figure 4.8a. These polynomials are 





1 


Ci(f2) = 




C2(f2) = 


1Q} - 1 


C3(^2) = 


- 3f2 


C4(f2) = 


8^2"* -8^2^+1 


C5(S2) = 


16^2^ - 20f23 + 5^2 



(4.50) 



4.2.4 Properties of Chebyshev Polynomials 

Some of the properties of Chebyshev polynomials that are useful for our discus- 
sion are described below. Let cos(/> = S2. Then C„(«cos~^ S2) = cos(«(/>), and 
therefore we use the identity 

cos(A; -I- 1) = cos(^0) cos(0) — sin(fc(/)) sin(0) 

= 2cos(fe0) cos(0) - cos((jfc - 1)0) (4.51) 

from which we obtain a recursive formula to generate Chebyshev polynomials 
of any order, as 

Co(S2) = 1 

C;fc+i(S2) = 2S2Q(S2)-Cfc_i(S2) (4.52) 
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(a) 

lOlogtl + E^c/ (n)) 




(b) 

Figure 4.8 Chebyshev polynomials and Chebyshev filter: (a) magnitude of Chebyshev 
polynomials; (b) attenuation of a Chebyshev I filter. 



To see that C„{Q) — cos(« cos ^ Q) is indeed a polynomial of order n, consider 
it in the following form: 

cos(«0) = Re [e^"'^] 

= Re [cos(0) + j sin(0]" = Re + j^/(l-(j)^J 



= Re 



0 + V02 _ 1 



(4.53) 



Expanding 



0 + V02 _ 1 



by the binomial theorem and choosing the real part, 



we get the polynomial for 



n(n — 1) „ 9 9 
cos(n0) = 0" + ^, - 1) 



(4.54) 
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Recall that since n is a positive integer, the expansion expressed above has a 
finite number of terms, and hence we conclude that it is a polynomial (of degree 
n). We also note from (4.50) that 

C„2(0)=(0 « «dd 
" [1 n even 



But 



Clil) = \\ " ""^^ (4.56) 
" [1 n even 



So we derive the following properties: 



9 f 1 n odd 

/f(0)P= 1 (4.57) 

' ^ — L^ n even ^ ' 

|H(1)|2 = ^— n odd or even (4.58) 
1 + e2 



The attenuation characteristics of the Chebyshev filter of order n = 4 is shown in 
Figure 4.8b as an example. The magnitude \H{jQ)\ plotted as "Example(4)" in 
Figure 4.7 has an equiripple response in the passband, with a maximum value of 
0 dB and a minimum value of 101og[l/(l +6^)] decibels. However, the mag- 
nitude of Chebyshev I lowpass filters is 101og[l/(l + e^)] at ^2 = 1 for any 
order n. The magnitude of the ripple can be measured as either \H(0)\ — \H(1)\ 

or |/f(0)|2 - |/f(l)|2 = 1 _ [1/(1 + g2)] ^ [^2/(1 ^ g2)] ^ ai^ayg 

calculate = (10° ''*'' - 1). 

Another property of Chebyshev I filters is that the total number of maxima and 
minima in the closed interval [—1 1] is n + 1. The square of the magnitude 
response of Chebyshev lowpass filters is shown in Figure 4.9a to indicate some 
properties of the Chebyshev lowpass filters just described. 



4.2.5 Design Theory of Chebyshev I Lowpass Filters 

Typically the specifications for a lowpass Chebyshev filter specify the maximum 
and miiumum values of the magnitude in the passband; the cutoff frequency cOp, 
which is the highest frequency of the passband; a frequency cos in the stopband; 
and the magnitude at the frequency cOs. As in the case of the Butterworth filter, we 
normalize the magnitude and the frequency and reduce the given specifications 
to those of the normalized prototype lowpass filter and follow similar steps to 
find the poles of H(p). 

Since Q can take real values greater than one in general, let us assume 0 to be 
a complex variable: 4> — Vi + jfi- From 1 + e^C^(f2) = 0, we get e^CliO.) = 
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\ n = 3{odd) 




1^ - 



I \ n = 4 (even) 





n = 4 (even) 



Figure 4.9 Magnitude response of Chebysiiev filters: (a) Chebyshev I filters; 
(b) Chebyshev II filters. 



— 1 = j ; we derive 

— cos(n0) = cos(n((pi + j(p2)) 

— cos(«^i) cosh(n^2) ~ J sin(n^i) sin(n<p2) 
Equating the real and imaginary parts, we get 

cos(m(Pi) cosh(«^2) — 0 

and 



sm{n(pi) sin(n^2) — T" 



1 



From (4.60) we get 



(2k - l)7r 
2n 



(4.59) 

(4.60) 
(4.61) 

(4.62) 
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Substituting this in (4.61), we obtain sinh(«^2) = ±(l/e), from which we get 

<P2=^ sinh"' (4.63) 

Now Q = cos(0) = cos((pi + j(p2) = cos((pi) cosh(992) — j sin((pi) sinh(^2)- 
Therefore 



jQ = sin(^i) sinh((p2) + j cos{(pi) cosh(^2) 



(4.64) 



These are the roots in the p plane that satisfy the condition 1 + €^C^(Q) = 0. 
Hence the 2n poles of H(p)H{—p) are given by 



pic = siah{(p2) sin 



(2k-l)n' 
2^ 



+ 7COsh(^2)cos 



{2k-\)n 
In 



for 



k=\,2,...,{2n) 



(4.65) 



The 2n poles of H{p)H{—p) given by (4.65) can be shown to lie on an elliptic 
contour in the p plane with a major semiaxis equal to cosh(^2) along the jQ 
axis and a minor semiaxis equal to sinh((p2) along S axis, where p = J2+j^- 
We find that the frequency at which the attenuation of the prototype filter is 
3 dB is given by 



= cosh 



1 



■ cosh' 



The poles in the left half of the p plane only are given by 



(4.66) 



Pk = - sinh(^2) sin 



i2k - l)7t 
2^1 



+ j COSh((p2) COS 



i2k - 1)tt 



= — sinh(^2) sin(0;t) + j cosh((p2) cos(%) k= I, 2, 3, ... ,n (4.67) 



where (p2 is obtained from (4.63). In (4.67), note that 6^ are the angles measured 
from the imaginary axis of the p plane and the poles lie in the left half of the 
p plane. 

The formula for finding the order n is derived from the requirement that 
101og[l + e2c2(i2,)]> A,. Itis 



cosh-i -/[(lOO i'*- - Vs/ilOP-^'^p - 1)1 

n > (4.68) 

cosh 



and the value of [n] is chosen for calculating the poles using (4.67). Given cOp, 
Ap, (Os, and as the specifications for a Chebyshev lowpass filter H{s), its 
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maximum value in the passband is normahzed to one, and its frequencies are 
scaled by cOp, to get the values of Q.p = \ and Q.s = cOg/cOp for the prototype 
filter at which the attenuations are Ap and A,, respectively. The design procedure 
to find H{s) starts with the magnitude squared function (4.48) and proceeds as 
follows: 



1. Calculate e = ^{IQ^-^^p - 1). 

2. Calculate n from (4.68) and choose n = \n\. 

3. Calculate (p2 from (4.63). 

4. Calculate the poles pi, (k = 1,2, ... ,n) from (4.67). 

5. Compute H{p) = H^/iYYUiP ' W)] = ^o/CLo ^-fe/J- 

6. Find the value of Hq by equating 



do 



1 



l + e^ 



n odd 
n even 



7. Restore the magnitude scale. 

8. Restore the frequency scale by substituting p = s/cop in H{p) and simplify 
to get H{s). 



A simple example is worked out below to illustrate this design procedure. 



Example 4.4 

Let us choose the specifications of a lowpass Chebyshev filter with a maxi- 
mum gain of 5 dB, a bandwidth of 2500 rad/s, and a stopband frequency of 
12,500 rad/s; Ap = 0.5 dB, and A^ = 30 dB. For the prototype filter, the maxi- 
mum value in the passband is one (0 dB), and we have Qp = I, = 5. So 

1. € = 7(100 05 - 1 = 0.34931. 

2. n> {cosh-i y[(103 - 1)/(10005 _ l)]}/[cosh-i(5)] = 2.2676; choose 
n = 3. 

3. (p2 = ^ sinh-1 (03^53^) = 0.591378. 

4. pk = -0.313228 ± yi.02192 and -0.626456. 

5. Hip) = Ho/[ip + 0.31228 - jl. 02192) (p + 0.31228 + 7 1. 02192) (p + 
0.626456)] = Hq/[(p^ + 0.626456^> + 1. 142447) (/? + 0.626456)]. 

6. HiO) = 7?o/[(l-142447)(0.626456)] = 1 (since n = 3 is odd). Hence Hq = 
0.715693. 

7. The transfer function with a direct-current (DC) gain of 0 dB is H{p) = 
0.715693/[(/ + 0.626456/7 + \.\A2AAl){p + 0.626456)]. The magnitude 
scale is restored by multiplying H{p) by 1.7783, so that the DC gain is 
raised to 5 dB. 
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8. The transfer function of the filter is 

Hip) = ^"-^^^^^^^^^-^^^^^ (4.69) 

(p2 + 0.626456^9+ 1.142447) (p + 0.626456) ^ ^ 

When we substitute p = i/2500 in this H(p) and simplify the expression, we get 

19.886 X 1012 

^ ~ (52 + 15665 + 714 X 106)(5 + 1566) ^'^''^^^ 

The magnitude response of the prototype filter in (4.70) is marked as "Example(4)" 
in Figure 4.7. The three magnitude responses are plotted in the same figure so 
that the response of the three filters can be compared. The attenuation of the 
Chebyshev filter at ^2, = 5 is found to be 47 dB. The abovementioned class of 
filters with equiripple passband response and monotonic response in the stopband 
are sometimes called Chebyshev I filters, to distinguish them from the following 
class of filters, known as Chebyshev II filters. 



4.2.6 Chebyshev II Approximation 

The Chebyshev II filters have a magnitude response that is maximally flat at a» = 
0; it decreases monotonically as the frequency increases and has an equiripple 
response in the stopband. Typical magnitudes of Chebyshev 11 filters are shown 
in Figure 4.9b. This class of filters are also called Inverse Chebyshev filters. The 
transfer function of Chebyshev II filters are derived by applying the following 
two transformations: (1) a frequency transformation Q. = 1/co in \H(jQ)\^ of 
the lowpass normalized prototype filter gives the magnitude squared function of 
the highpass filter \H{l/jQ)\^, with an equiripple passband in \Q\ > 1 and a 
monotonically decreasing response in the stopband 0 < \Q\ < 1; (2) when it is 
subtracted from one, we get the magnitude squared function (4.72) of the inverse 
Chebyshev lowpass filter: 



1 

H — 
jO. 



1 



l + €^C„^(l/^2) 



(4.71) 



1 €^C^{l/Q) 1 

1 = — - — = (4 72) 

l + e2c2(l/f2) l + e2c2(l/^2) [1+1 1 

The magnitude squared function \H{jQ)\^ of a lowpass Chebyshev I filter 
and \H(-^)\^ and 1 - \H{J^)\^ are shown in Figure 4.10. 

We make two important observations in Figure 4.10. The normalized cutoff 
frequency S2 = 1 becomes the lowest frequency in the stopband of the inverse 
Chebyshev filter at which the magnitude is £2/(1 + e^). Hence the frequencies a>p 
and a>s specified for the inverse Chebyshev filter must be scaled by cos and not by 
cDp to obtain the prototype of the inverse Chebyshev filter. We also observe that 
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Q 

Figure 4.10 Transfomiation of Chebyshev I-Chebyshev II filter response. 




when n is odd, the number of finite zeros in the stopband is (n — l)/2 = m. When 
n is an odd integer, the term secOk, which is involved in the design procedure 
described below, attains a value of oo when k — (n + l)/2. So one of the zeros 
is shifted to joo; the remaining finite zeros appear in conjugate pairs on the 
imaginary axis, and hence the numerator of the Chebyshev II filter is expressed 
as shown in step 6 in Section 4.2.7. Note that the value of €, calculated in step 1 
is different from the value calculated in the design of Chebyshev I filters and 
therefore the values of cpi used in steps 3 and 4 are different from (p2 used in 
the design of Chebyshev I filters. Hence it would be misleading to state that the 
poles of the Chebyshev II filters are obtained as "the reciprocals of the poles of 
the Chebyshev I filters." 
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4.2.7 Design of Chebyshev II Lowpass Filters 

Given cOp, Ap, cOg, and the maximum value in the passband, we scale the 
frequencies tOp and cos by tOs and deduce the specifications for the normalized 
prototype lowpass inverse Chebyshev filter. Equation (4.72) is the magnitude 
squared function of this inverse Chebyshev filter, and we follow the design pro- 
cedure as outlined below: 

1. Calculate e,- = 1/^/(10°-^^^ - 1). 

2. Calculate 



cosh"' J[(100 i'i- - l)/(100-'^p - 1)] 

n > ^ -. 

cosh 

and choose n = [«! ■ 

3. Calculate ^, from tpi = (1/n) sinh~^(l/e,). 

4. Compute the poles in the left-half plane p^: 

1 

Pk = k = 1,2,3, ... ,n 

- smh((pi) siniOk) + j cosh(^,) cos(Ok) 

5. The zeros of the transfer function H(p) are calculated as zk = ^j^ok = 
j sec 9k for k = 1,2, . . . ,m = \n/2\ and the numerator N{p) of H{p) as 



Compute 



"iP) = — Ffn 7 T — 



and calculate Ho = Ul=i(Pk)/ ULii^okf- 

7. Restore the magnitude scale. 

8. Restore the frequency scale by putting p = s/cos in H{p) to get H{s) for 
the inverse Chebyshev filter. 

Example 4.5 

Design the lowpass inverse Chebyshev filter with a maximum gain of 0 dB 
in the passband, cOp = 1000, Ap = 0.5 dB, = 2000, and A, = 40 dB. We 
normalize the frequencies by cOs and get the lowest frequency of the stopband 
at f2 = 1, while cOp — 1000 maps to ~ 0.5. We will have to denormalize the 
frequency by substituting p = 5/2000 when the transfer function H{p) of the 
inverse Chebyshev filter, obtained by the steps given above, is completed. The 
design procedure gives 



2. n = 5. 
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3. (pi = i sinh-n99.995) = 1.05965847. 

4. Poles in the left half-plane are pk = (-0.155955926 ± j0.6108703175), 
(-0.524799485 ± 70.485389011), and (-0.7877702666). 

5. Zeros are z\ — ±jl.0515 and Z2 — ±71.7013. 

6. The transfer function of the inverse Chebyshev filter H{p) is given by 

go(p'+1.0515^)(p2 + 1.7013^) 

(p^ + 0.3118311852/7 + 0.3974722176) 
(p2 + 1.04959897/7 + 0.51 10169847) (/? + 0.787702666) 

7. Calculate Hq = 0.049995. 

8. Hence we simplify H(p) to the final form: 

0.049995(/74 + 4.04/^2 + 3.2002) 
p^ + 2.1491328/?'* + 2.30818905/?^ + 1.54997/?2 
+ 0.657255 15/? + 0. 15999426 



The magnitude response of (4.73) is plotted in Figure 4.11. It is seen that the 
prototype filter meets the desired specifications. Now we only have to denormal- 
ize the frequency by 2000, so that the passband of the specified filter changes 
from 0.5 to 1000 rad/s, and it meets the specifications given in Example 4.5. 
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Figure 4.11 Magnitude response of Chebyshev II lowpass filter. 
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4.2.8 Elliptic Function Approximation 

There is another type of filter known as the elliptic function filter or the Cauer 
filter. They exhibit an equiripple response in the passband and also in the stop- 
band. The order of the elliptic filter that is required to achieve the given spec- 
ifications is lower than the order of the Chebyshev filter, and the order of the 
Chebyshev filter is lower than that of the Butterworth filter. Therefore the elliptic 
filters form an important class, but the theory and design procedure are complex 
and beyond the scope of this book. However, in Section 4.11 we will describe 
the use of MATLAB functions to design these filters. 



4.3 ANALOG FREQUENCY TRANSFORMATIONS 



Once we have learned the methods of approximating the magnitude response 
of the ideal lowpass prototype filter, the design of filters that approximate the 
ideal magnitude response of highpass, bandpass, and bandstop filters is easily 
carried out. This is done by using well-known analog frequency transformations 
p = g{s) that map the magnitude response of the lowpass filter H(jQ) to that of 
the specified highpass, bandpass, or bandstop filters Hijco). The parameters of 
the transformation are determined by the cutoff frequency (frequencies) and the 
stopband frequency (frequencies) specified for the highpass, bandpass, or band- 
stop filter so that frequencies in their passband(s) are mapped to the passband of 
the normalized, prototype filter, and the frequencies in the stopband(s) of the high- 
pass, bandpass, or bandstop filters are mapped to the stopband frequency of the 
prototype filter. After the normalized prototype lowpass filter H(p) is designed 
according to the methods discussed in the preceding sections, the frequency trans- 
formation p = g{s) is appUed to H{p) to calculate the transfer function H(s) of 
the specified filter. With this general outline, let us consider the design of each 
filter in some more detail. 



4.3.1 Highpass Filter 

It is easy to describe the design of a highpass filter by choosing an example. 
Suppose that a highpass filter with an equiripple passband cop <\co\ < oo is 
specified, along with a stopband frequency w, . The magnitude at cOp, which is 
the cutoff frequency of the passband, and also the magnitude at cnj (or Ap and A^) 
are given. The lowpass-highpass (LP-HP) frequency transformation p = g{s) 
to be used in designing the highpass (HP) filters is 

P='^ (4.75) 

It is seen that when s = jcop, the value of p = —j and when s = —jMp, the 
value of p = J. It can also be shown that under this transformation, all frequen- 
cies in the passband of the highpass filter map into the passband frequencies 
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— 1 < f2 < 1 of the lowpass prototype filter. We calculate the frequency ^2^ to 
which the specified stopband frequency cOs maps, by putting s = jcos in (4.75). 
The stopband frequency is found to be — (^p/(^s- So the specified magnitude 
response of the highpass filter is transformed into that of the lowpass prototype 
equiripple filter. We design the prototype lowpass filter to meet these specifica- 
tions and then substitute p = cop/s in H{p) to get the transfer function H{s) of 
the specified highpass filter. 



Example 4.6 



The cutoff frequency of a Chebyshev highpass filter is cOp = 2500, which is the 
lowest frequency in the passband, and the maximum attenuation in the passband 
Ap = 0.5 dB. The maximum gain in the passband is 5 dB. At the stopband 
frequency to^ = 500, the minimum attenuation required is 30 dB. Design the 
highpass filter H(s). 

When we apply the LP-HP transformation p = 2500/^, the cutoff frequency 
(Op = 2500 maps to S2p = 1 and the stopband frequency tOs maps to Qs = 5. 
In the lowpass prototype filter, we have Qp — 1, — 5, Ap — 0.5 dB, As = 
30 dB, and the maximum value of 5 dB in the passband. This filter has been 
designed in Example 4.3 and has a transfer function given by (4.70), which is 
repeated below: 

(0.715693)(1.7783) 

H(p) = — ^ 

^ (p^ + 0.626456p + 1.142447)(p + 0.626456) 

Next we substitute p — 2500/^ in this transfer function, and when simplified, 
the transfer function of the specified highpass Chebyshev filter becomes 



His) = 



(0.715693)(1.7783) 



(p2 + 0.626456p + 1.142447)(p + 0.626456) 

1.7783^^ 

[i2 + 1370.95 + 5.4707 x lO^'jis + 3990] 



p=250O/s 

(4.76) 



The magnitude response of (4.76) is plotted in Figure 4.12 and is found to exceed 
the specifications of the given highpass filter. The design of a highpass filter with 
a maximally flat passband response or with an equiripple response in both the 
passband and the stopband is carried out in a similar manner. 



4.3.2 Bandpass Filter 

The normal specifications of a bandpass filter H(s) as shown in Figure 4.13 
are the cutoff frequencies coi and co2, the maximum value of the magnitude in 
the passband between the cutoff frequencies, the maximum attenuation in this 
passband or the minimum magnitude at the cutoff frequencies wi and C02, and a 
frequency a>s (= 0)3 or C04) in the stopband at which the minimum attenuation or 
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Figure 4.12 Magnitude response of a highpass filter. 
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Figure 4.13 Typical specifications of a bandpass filter. 



the maximum magnitude are specified. The type of passband response required 
may be a Butterworth or Chebyshev response. 

The lowpass-bandpass (LP-BP) frequency transformation p — g(s) that is 
used for the design of a specified bandpass filter is 

1 /s^ + CL>l\ 
^ = 77 (4-77) 
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where B = (02 — coi is the bandwidth of the filter and coq = y/coicox is the geo- 
metric mean frequency of the bandpass fiher. 

A frequency s — jcok in the bandpass filter is mapped to a frequency p = jQ^ 
under this transformation, which is obtained by 



Therefore the frequencies cwi and u>2 map to = =f1, and the frequencies —coi 
and —ct>2 map to f2 = ±1. Similarly, the positive value of the stopband frequency 
Qs to which the frequency cOs maps is calculated from 



The magnitude or the attenuation at the frequencies Q = 1 and Qs for the 
prototype filter are the same as those at the corresponding frequencies of the 
bandpass filter. From the specification of the lowpass prototype filter, we obtain 
its transfer function H(p), following the appropriate design procedure discussed 
earlier. Then we substitute (4.77) in H(p) to get the transfer function H(s) of 
the bandpass filter specified. 

Example 4.7 

The specifications of a Chebyshev I bandpass filter are coi = 10"^, (02 = 10^, 
tWj = 2 X 10^, = 0.8 dB, and As = 30 dB, and the maximum magnitude in 
the passband = 10 dB. We use the following procedure to design the filter: 



1. = 0)2 - = 9 X 10"^ and (tfo = ^/o)^ = VW = 31.62 x 10^ 

2. The LP-BP transformation is p = 1/9 x lO'^lis^ + 10^) /s]. 

3. Let 5 = jcos = j2 X 10^. From the preceding transformation, we get = 



4. The lowpass Chebyshev prototype filter has a magnitude response as 
shown in Fig. 4.6b. 



5. Calculate e = y/lO'^-^'^p - 1 = VlOO O^ - 1 = 0.4497. 

6. Calculate n from (4.68). Choose n = [3.5] = 4. 

7. Calculate (p2 from (4.63). We get ^2 = 0.3848. 

8. Calculate the poles from (4.67): pk = -0.15093 ± j.9931 and -0.36438 ± 




(4.78) 




(4.79) 




(4.80) 



2.1667. 



y. 41137. 
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Magnitude response of the bandpass filter 




Frequency in rad/sec-log scale 
Figure 4.14 Magnitude response of the bandpass filter in Example 4.6. 



9. The transfer function of the lowpass prototype Chebyshev filter is derived 
from H{p) = Hq/{\ 
of 10 dB at ^2 = 0: 



from H{p) — Hq/\\^i^^^{p — pk)] where is fixed to match the gain 



0.8788 

H{p) = . (4.81) 

^ (/72 + O.3OI8/J+ 1.009)(/j2 + 0.7287/7 + 0.302) 

10. Now substitute p ^ {s'^- + \{f )/{9 x lO'^s) in H{p) and simplify to 
get H{s) 

5.7658 X lO^V 

H{s) = 

D(s) 

where 



D(s) = 



(^4 + 2.7162 X 10^^^ + 101.729 x lO^s^ + 2.7162 x lO'^^ + lO^**) 
X {s* + 6.5583 X lO'^s^ + 44.462 x lOh^ + 6.5583 x lO'^^ + 10'^) 

(4.82) 



To verify the design, we have plotted the magnitude response of the bandpass 
filter in Figure 4.14. 

4.3.3 Bandstop Filter 

The normal specification of a bandstop (bandreject) filter is shown in Figure 4.15. 
The passband of this filter is given hy 0 < co < cdi and 0)2 < co < 00, whereas 




the frequencies co^ and 0)4 define frequencies in the stopband. Usually these 
frequencies and the corresponding magnitudes are given as the specifications. 
Note that in Figure 4.13, showing the magnitude response of a bandpass filter, 
the stopband is equiripple and the passband between a>i and 002 has a monotonic 
response; this it is a Chebyshev II type of filter. But in the bandstop filter response 
shown in Figure 4.15, the passband is equiripple and the stopband is maximally 
flat, so it is a Chebyshev I type of bandstop filter. It is important to remember 
that the parameter B in the LP-BS transformation is chosen as cd2 — <wi , and not 
the bandwidth C04 — cd^ of the stopband! The mean frequency cdq — ^u)2U)\, and 
the LP-BS frequency transformation p — g{s) 'vi, given by 




(4.83) 



This transformation transforms the entire passband of the bandstop filter to the 
passband | ^2 1 < 1 of the prototype lowpass filter. So we have to find the frequency 
Q.S to which the stopband frequency cOs is transformed under the transformation. 
It is found from 



(4.84) 



Thus we have reduced the specification of a bandstop filter to that of a proto- 
type lowpass filter. It is designed by the procedures discussed earlier. When the 
transfer function H{p) of the prototype filter is completed, the transformation 
p — B[s/(s^ + Mq)] is used to transform H(p) into H{s). The design of the 
bandstop filter is illustrated by the following example. 
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Example 4.8 

Suppose that we are given the specification of a bandstop filter as shown in 
Figure 4.15. In this example, we are given coi = 1500, ft>2 = 2000, cOs = a>4 = 
1800, Ap = 0.2 dB, and = 55 dB. The passband is required to have a max- 
imally flat response. With these specifications, we design the bandstop filter 
following procedure given below: 

1. B = 2000 - 1500 = 500 and coq = V (2000) (1500) = 1732.1. 

2. The LP-BS frequency transformation is p = 500[s/is'^ + 3 x 10^)]. 

3. Let s = jco, = 7 1800. Then we get Q., = 3.74. 

4. Following the design procedure used in Example 4.2, we get e = 
V 100 02 - 1 = 0.21709, and from (4.44), we get n = 5.946 and choose 
n = 6. 

5. The six poles are calculated from (4.45) as pk = —0.33385 ± 71.2459, 
-0.9121 ± 7O.9121, and -1.246 ± 70.3329. 

6. The transfer function of the lowpass prototype filter H{p) is constructed 
from H{p) = Ho/[Y\Li(P - Pk)^ as 

(1.664)3 

(p2 + 0.6677/7 + 1.664)(p2 + L824/7 + 1.664)(p2 + 2.492/7 + 1.664) 

(4.85) 

7. Next we have to substitute p = 500[s/is^ + 3 x 10^)] in this H{p) and 
simplify the expression to get the transfer function H(s) of the speci- 
fied bandstop filter. This completes the design of the bandstop filter. The 
magnitude response is found to exceed the given specifications. 

The sections above briefly summarize the theory of approximating the piece- 
wise constant magnitude of analog filters. This theory will be required for approx- 
imating the magnitude of digital filters, which will be treated in the following 
sections. The analog frequency transformations p — g{s) applied to the lowpass 
prototype to generate the other types of filters are listed in Table 4.2. 



TABLE 4.2 Frequency Transformations to Design HP, BP, and BS Filters 


Type of 


Transformation 




Transformation 


P = g(s) 


Parameters Used 


LP-LP 


P = s/a)p 


cop = bandwidth-specified LP 






filter 


LP-HP 


p = COp/s 


(Dp = cutoff frequency of the 






specified HP filter 


LP-BP 


p = (1/B)[(52 + col)/s] 


B = C02 — oj[, where B is 




bandwidth of the specified 






BP filter: coq = ^m\(02\ 


LP-BS 


p = B[s/is^ + col)] 


B = a>2 — a>i 
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4.4 DIGITAL FILTERS 

In contrast to analog filters, digital filters are described by two types of transfer 
functions: transfer functions of finite impulse response filters and those of infinite 
impulse response filters. The methods for designing FIR filters will be treated 
in the next chapter. Now that we have reviewed the methods for approximating 
the magnitude of analog filters, it is necessary to understand the relationship 
between the frequency-domain description of analog and digital filters, in order 
to understand the frequency transformation that is used to transform the analog 
frequency response specifications to those of the digital filters. 



4.5 IMPULSE-INVARIANT TRANSFORMATION 

The procedures used for designing UR filters employ different transformations 

of the form s = f{z) to transform H(s) into H(z). The transformation s = f(z) 
must satisfy the requirement that the digital filter transfer function H{z) be stable, 
when it is obtained from the analog filter transfer functions H(s). The transfer 
functions for the analog filters obtained by the methods described above are stable 
functions; that is, their poles are in the left half of the s plane. When H{s) and 
fiz) are stable in the s and z domains, respectively, the poles of H(s) in the left 
half of the .v plane map to the poles inside the unit circle in the z plane; therefore 
H(z) also is a stable transfer function. We also would like to have frequencies 
from — oo to oo on the ja> axis of the s plane mapped into frequencies on the 
boundary of the unit circle — without encountering any discontinuities. 

We have already introduced the transformation z = e"^ , in Chapter 2, when 
we derived the z transform of a discrete-time signal x{nT) generated from the 
analog signal x(t). 

We plot the magnitude response of the analog filter as a function of co. Under 
the impulse-invariant transformation, s = jco maps to z = e^""^. Although the 
magnitude of the digital filter H{e^'"^) is a function of the variable e^'"^, we 
cannot plot it as a function of e^'^^ . We can plot the magnitude response of 
the digital filter only as a function of coT. (Again, we point out that the nor- 
malized digital frequency a)T is commonly denoted in the DSP literature by 
the symbol u>.) When s = jco increases values from —joo along the imaginary 
axis to -I- joo, the variable e-''"^ increases counterclockwise from e~j^ to e->^ 
(passing through z = 1) along the boundary of the unit circle in the z plane and 
repeats itself since e-''"^ = gJi'^T+^rK) ^ where r is an integer. The strips in the 
left half of the s plane bounded by ±j[(2r - 1)^/7] and ±j[{2r + \)7t/T] 
on the jco axis are mapped to the inside and the boundary of the unit cir- 
cle in the z plane as shown in Figure 4.16. Therefore the frequency response 
X*{jco) = Xl^o^("^)^ ■'"^ periodic and will avoid aliasing only if the ana- 
log signal x(t) is bandlimited. 

Consider the transfer function H{s) of an analog filter. Since the poles of an 
analog filter function such as the filters discussed in this chapter are simple, its 



220 



INFINITE IMPULSE RESPONSE FILTERS 




partial fraction expansion is of the form 

H{s)^y\ (4.86) 

S + Si, 
k=l * 

The unit impulse response hkit) of a typical term Rk/(s + s^) is Rke~^''' . When 
it is sampled with a sampling period T, and the z transform is evaluated, it 
becomes 

oo ^ 
n=0 

Hence H{z) derived from H{s) under the transformation z — e^^ is given by 

(4.88) 

k=\ ^ 

Because the unit pulse response h{nT) of the digital filter matches the unit 
impulse response h{t) at the instants of sampling t — nT, the transformation z — 
e"^ is called the impulse-invariant transformation. But the frequency response of 
H(z) will not match the frequency response of H{s) unless h{t) is bandlimited. 
If the magnitude response of the analog filter Hijoj) is very small for frequencies 
larger than some frequency cot,, and h(t) is sampled at a frequency greater than 
Icoh, the frequency response of the digital filter H(z) obtained from the impulse- 
invariant transformation may give rise to a small amount of aliasing that may 
or may not be acceptable in practical design applications. However, this method 
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is not applicable for the design of highpass, bandstop, and allpass filters since 
their frequency responses are not bandlimited at all. If the impulse-invariant 
transformation is applied to a minimum phase analog filter H(s), the resulting 
digital filter may or may not be a minimum phase filter. For these reasons, the 
impulse-invariant transformation is not used very often in practical applications. 

4.6 BILINEAR TRANSFORMATION 

The bilinear transformation is the one that is the most often used for designing 
nR filters. It is defined as 

To find how frequencies on the unit circle in the z plane map to those in the .v 
plane, let us substitute z = e-''^^ in (4.89). Note that co is the angular frequency 
in radians per second and coT is the normalized frequency in the z plane. Instead 
of using 0) as the notation for the normalized frequency of the digital filter, we 
may denote 0 as the normalized frequency to avoid any confusion in this section: 

T l^eJ(<«7-/2) +g-; (cor/2) j - jj^^^ ) 

This transformation maps the poles inside the unit circle in the z plane to the 
inside of the left half of the s plane and vice versa. It also maps the frequencies 
on the unit circle in the z plane to frequencies on the entire imaginary axis of 
the s plane, where s = a + jk. So this transformation satisfies both conditions 
that we required for the mapping s = f{z) mentioned in the previous section or 
its inverse relationship z = b(s). This mapping is shown in Figure 4.17 and may 
be compared with the mapping shown in Figure 4.16. 

To understand the mapping in some more detail, let us consider the frequency 
response of an IIR filter over the interval (0, (cos/2)), where a)s/2 = n/T is the 
Nyquist frequency. As an example, we choose a frequency response |//(e"^)| = 
of a Butterworth bandpass digital filter as shown in Figure 4.18a. 

In Figure 4.18, we have also shown the curve depicting the relationship between 
ctiT and X = 2/^ tan {coT/2). The value of A. corresponding to any value of coT = 9 
can be calculated from X = 2/j tan (6/2) as illustrated by mapping a few frequen- 
cies such as MiT, ci)2T in Figure 4.18. The magnitude of the frequency response 
of the digital filter at any normalized frequency u>kT is the magnitude of H{s) at 
the corresponding frequency s = jXk, where = 2/, tan {(0^7/2). 

The plot in Figure 4.17 shows that the magnitude response of the digital filter 
over the Nyquist interval (0, n) maps over the entire range (0, oo) of X. So there 
is a nonlinear mapping whereby the frequencies in the o) domain are warped 



1 



T V + 1 



= j2fs tan ( — ) = 
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Image of s 








)l 


Image of left 




half s-plane 





s-plane z-plane 
Figure 4.17 Mapping of s plane to z plane under bilinear transformation. 




Figure 4.18 

analog BP =^ 



0)1 

(a) 

Mapping of the digital filter response under bilinear transformation and 
LP transformation. 



when mapped to the X domain. Similarly, the frequencies in the interval (0, — tt) 
are mapped to the entire interval (0, —oo) of X. From the periodic nature of 
the function tan(.), we also see that the periodic replicates of the digital filter 
frequency response in the w domain map to the same frequency response in the 
X domain and the transfer function H{s) obtained under the bilinear transform 
behaves like that of an analog filter. But it is to be pointed out that we use only 
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the mathematical theory of analog filter approximation to solve the problem of 
finding such a function H(s), and we are not designing an analog filter. In other 
words, the bilinear transformation helps us reduce the mathematical problem of 
approximating the frequency response of a digital filter in the variable o), to 
the problem of approximating another function in the variable k. Because of its 
similarity to the analog frequency, the approximation problem is solved by using 
the mathematical theory of approximation for the frequency response of analog 
filters. So, if the frequency response \H{jX\ is a lowpass frequency response, the 
frequency is linearly scaled by to obtain the frequency response \H(jQ)\ of 
a lowpass prototype filter. If it is a highpass, bandpass, or bandstop response, then 
the appropriate analog frequency transformation p = g{s) listed in Table 4.2 is 
used to convert the specification \H(jX\ to that of an analog prototype lowpass 
filter. We obtain the transfer function H{p) of the prototype filter, in which 
the complex frequency variable p is shown in bold in order to differentiate it 
from H(p), and its magnitude is denoted by \H(jQ)\. The theory of analog filter 
approximation is used to find H{p) such that its magnitude \H(jQ)\ approximates 
the magnitude response of the lowpass prototype filter. It is important to note 
that the unit impulse response of the filter H(p) when sampled with a sampling 
period T does not match the unit pulse response of the digital filter H(z), because 
the bilinear transformation is not impulse- invariant. 

Once we have designed the lowpass prototype filter function H(p), we apply 
the appropriate analog frequency transformation p = g{s) to H{p) to get the 
function H(s). Then we substitute s = 2/^[(z - l)/(z + 1)] in H(s) to get Hiz) 
as the transfer function of the digital filter. 

Example 4.9 

The specified magnitude response of a maximally flat bandpass digital filter has a 
maximum value of 1.0 in its passband, which lies between the cutoff frequencies 
^1 = OAtt and 02 = 0.5jt . The magnitude at these cutoff frequencies is specified 
to be no less than 0.93, and at the frequency 6^ = O.Vtt in the stopband, the 
magnitude is specified to be no more than 0.004. Design the IIR digital filter that 
approximates these specifications, using the bilinear transformation. 

It is obvious from these specifications that the frequencies are normalized 
frequencies. So 9i = OAn and 62 = O.Sjt are the normalized cutoff frequencies 
and O3 = OJn is the frequency in the stopband. The specified magnitude response 
is plotted in Figure 4.19a. The two cutoff frequencies (01,(02 and the stopband 
frequency co^ map to and li, A2, A3 as follows. In this example, we have chosen 
to scale the frequencies in the s plane by fs; thus, the values for A,i, A.2, and A.3 
given below are obtained by the bilinear transform s = 2[{z — l)/(z + 1)]: 

A.1 = 2tan(0.2:?r) = 1.453 rad/s 
X2 = 2tan(0.25:?r) = 2.00 rad/s 
A.3 = 2tan(0.35:7r) = 3.95 rad/s 

The frequency response of the "analog" filter H{s) is plotted in Figure 4.19b. 
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Now we find the bandwidth (BW) — X2 — — 0.547 and the center fre- 
quency Xq — V^2^i — 1-705 for the prewarped bandpass filter function \H(jX)\. 
Next we define the lowpass-bandpass frequency transformation 

^~Tb) \ ~s / ~ 0.547 V ~s ) ' 

To find the frequency ^^3, to which the frequency A3 — 3.95 maps, we sub- 
stitute s = y'3.95 in the preceding transformation and get p — j5.S16 — jQ.2, 
whereas the cutoff frequencies map to the normalized frequency Q.p — 1. Hence 
the magnitude response of the lowpass Butterworth prototype filter function is as 
shown in Figure 4.19c. Using the same notations as before, we get Ap — 0.63 dB, 
As = 48 dB, e — 0.395, and « = 4 for this prototype lowpass Butterworth filter. 

The four poles in the left half of the p plane are calculated as the poles of the 
lowpass prototype Butterworth filters: 



pi P4 = -0.4827 ± ;1.1654 
P2,P3 = -1.1654 ± jO.4827 
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10-'' 10° iC 

Frequency in rad./sec 

Figure 4.20 Magnitude response of the analog prototype lowpass filter in Example 4.8. 



The transfer function of the prototype lowpass filter is therefore given by 

2.5317 

^^^^ ~p4 + 3.296p3 + 5.4325p2 + 5.24475p + 2.5317 ^"^'^^^ 

The magnitude response of this lowpass filter is plotted in Figure 4.20. 

Next we substitute p = (l/0.547)[(i2 + l.705^)/s], in (4.90) and after sim- 
plifying, the resulting transfer function is 

0.2267/ 

His) = 

Dis) 

where D{s) is given by 



(s^ + 1.8030^^ + 13.2535^*^ + 16.5824^^ + 60.3813^" 
+ 48.205^3+ 112.0006^2+ 44.2926s +71.4135) 



(4.91) 



Now we apply the bilinear transformation s — 2[{z — l)/(z + 1)] we chose in 
this example, on this H(s), and simplify the transfer function H(z) of the digital 
filter to 

3.6272z^ - 14.50882" + 21.7632^^ - 14.50882^ + 3.6272 

H{z) = -p 



(3825z^ - 4221z^ + 13127z'5 - 98572^ + 157532^^ - 7615z^ 
+ 7849z2 - 1934z+ 1354) 

(4.92) 
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A plot of the magnitude response of this function is shown in Figure 4.21. It is 
found that the given specifications are met by this transfer function of the digital 
filter. 

The design of lowpass, highpass, and bandstop filters use similar procedures. 
In contrast to the impulse-invariant transformation, we see that the bilinear trans- 
formation can be used for designing highpass and bandstop filters as well. Indeed, 
the use of bilinear transformation is the most popular method used for the design 
of IIR digital filter functions that approximate the magnitude-only specifications. 



4.7 DIGITAL SPECTRAL TRANSFORMATION 

In the design procedure described above, we used the bilinear transformation to 
convert the magnitude specification of an IIR digital filter to that of H{jX) by 
prewarping the frequencies on the X axis. Then we either scaled the frequencies 
on the A axis or applied the analog frequency transformations p = g(^) to reduce 
the frequency response to that of a lowpass, analog prototype filter function. There 
is an alternative method for designing IIR digital filters. It replaces the analog 
frequency transformation by a frequency transformation in the digital domain. 
Constantinides [1] derived a set of digital spectral transformations (DSTs) that 
convert the magnitude of a lowpass digital filter with an arbitrary bandwidth, 
say, 6p, to that of digital highpass, bandpass, and bandstop filters or digital 
lowpass filters with a different passband. These transformations are similar to 
the analog frequency transformations, and the parameters of the transformation 
are determined by the cutoff frequencies of these filters just as in the case of the 
analog frequency transformations. Let us denote the cutoff frequency of the new 
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digital lowpass filter or the highpass filter by 9^; and let us denote the upper 
and lower cutoff frequencies of the bandpass and bandstop filters by 0„ and 6i, 
respectively — all of them are less than n radians on the normalized frequency 
basis. Whereas the lowpass, prototype analog filter always has a passband of 
1 rad/s, the lowpass digital filter has a passband that is chosen arbitrarily as Op-, 
yet, we will call it the lowpass digital, "prototype" filter, with a transfer function 
H{z~^). The digital spectral transformations applied on this digital filter are of 
the form = giz"^). They map points inside the unit circle in the z plane to 
points inside the unit circle in the z plane, and map the boundary of the unit 
circle in the z plane to the boundary of the unit circle in the z plane. Using these 
necessary conditions, Constantinides derived the DSTs for the LP-LP,LP-HP, 
LP-BP, and LP-BS transformations and they are Usted in Table 4.3, where 
9 = a>T are normalized frequencies in radians. 



Example 4.10 



We choose the same specifications as in Example 4.9 and illustrate the procedure 
to design the IIR filter using the digital spectral transformation from Table 4.3. 
Let us choose the passband of the lowpass prototype digital filter to be 9p = 
0.5n. The values for the cutoff frequencies specified for the bandpass filter are 
9i = 0.4;r, 9u = O.Stt. So we calculate 



'O.Stt + 

cos " 



0.47r^ 



ot = hr^ TT-r^ = 0.158 

cos 



^G.Stt -0.47r^ 

/0.5jt-0A7t\ /0.5n\ 
[ 2 j tan (^j = 6.314 



z-i 



K = cot 

z-2 - 0.273Z-1 + 0.727 



0.727Z-2 - 0.273Z-1 + 1 



Now we have to find the frequency 9s in the lowpass digital "prototype" filter 
to which the prescribed stopband frequency = 0.77r of the bandpass filter maps, 
by substituting z = e^^-''^ in the digital spectral transformation given above. The 
value is found to be 9s = 2.8 rad = 0.89137r rad. Therefore the specification 
for the lowpass prototype digital filter to be designed is given as shown in 
Figure 4.22b. 

Using the mapping of A. = 2tan(|) versus 9, we map this lowpass frequency 
response to the lowpass filter response \H(jX)\ as shown in Figure 4.22(c). We 
calculate Xp = 2tan(;T/4) = 1.998 and Xs = 2tan (^) = 11.6 as the edge of the 
passband and the edge of the stopband of this filter, respectively. So we scale its 
frequency by 1.998 to get the frequency response of the lowpass prototype filter 
H{jQ) in order to get a normalized bandwidth Qp = I. The stopband frequency 
Qs is scaled down to 5.8, which is slightly different from the value obtained in 
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TABLE 4.3 Digital Spectral Transformations 



Type of 

Transformation Transformation Parameters Used 

z"' - a 

LP-LP z ' = 0„ = passband of prototype 

1 — az~^ 



LP-HP 



LP-BP 



filter 

: passband of new LP filter 



sin 

a= \ ^ ) 

= — ( r I 9' = cutoff frequency of the 

y^+^^-'J HP filter 



/ -2 _ -1 , - 1) 



-^z~^ z"' + 1 / BP filter 



cos 

\ 2 ; 



lower cutoff frequency of 



\ + 1) (K + 1) 



K = cot 



2a , 1-K 

rz" + ■ 



: upper cutoff frequency of 
BP filter 



(^)-(l) 



LP-BS z ' = -j ^ + K _ jjj^gj. (,y(Qff frequency of 

i:i±2-2 + 1 BS filter 

9u = upper cutoff frequency of 
BS filter 



«■ = tan 



(^) 
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Figure 4.22 Mapping of magnitude responses under digital spectral transformation. 



Example 4.8 because of numerical inaccuracies. But the order of the lowpass 
prototype analog filter is required to be the same, and hence the transfer function 
is the same as in Example 4.8. The transfer function is repeated below: Note, we 
use H(p) to denote the lowpass filter in this example 

2.5317 

~ p4 + 3.2962p3 + 5.4325p2 + 5.2447p + 2.5317 

Next we restore the frequency scale by substituting p — i/ 1.998 in H{p) to get 
the transfer function H(s) as 

40.5072 

H(s) — (4 94) 

^4 _,_ 5 5924^3 _,_ 21.7352 _,_ 41 9576^ _,_ 40.5072 ^ 
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and then apply the bilinear transformation s = 2[(z — l)/(z + 1)] on this H(s) 
to get the transfer function of the lowpass prototype digital filter H{z) as 

_ (40.507224 + 162.0288z3 + 243.0432z2 + 162.0288z + 40.5072) 
^^^^ ~ (280.0816z4 + 160.3808z3 + 165.2032z2 + 35.6768z + 6.7728) 

(4.95) 

The final step is to apply the digital spectral transformation (4.96) derived earlier, 
to Hiz) in (4.95): 

_i z-2 - 0.273Z-1 + 0.727 

2 = (4 96) 

0.727Z-2 - 0.273Z-1 + 1 ^ ' 

The final result is the transfer function H{z) of the required IIR filter, which 

is found to be the same as (4.92) obtained in Example 4.8. The magnitude is 
therefore found to be the same as in Figure 4.21 and is not plotted again. When 
compared with the method of Example 4.8, the method described above does not 
offer any advantages; indeed, it requires more computations, particularly in the 
final step. However, if we already have the transfer function of a lowpass IIR 
filter, we can use the digital spectral transformation to obtain the transfer function 
of a HP, BP, or BS filter if their magnitude responses are of the same type (i.e., 
Butterworth, Chebyshev, or elliptic type) and the tolerances in the passband as 
well as the stopband are the same as those for the lowpass filter. 



4.8 ALLPASS FILTERS 



Allpass filters have a magnitude response that is exactly equal to a constant at 
all frequencies, and hence there is no need for any approximation. 
Such filters are of the form 



//ap(z"') = ± 



a(N) + a(N - l)z-i + ■ ■ ■ + a(2)z- 



iN-2) 



+ a(l)z 



-(N-l) 



+ Z" 



1 + a(l)z-i + a(2)z-2 + ■ ■ ■ + a(N - l)z-(w-i) + aiN)z-'^ 

(4.97) 

This is the ratio of two polynomials expressed in descending powers of z. Note 
that the coefficients of the numerator polynomial are in an order reverse that 
of the coefficients of the denominator polynomial. We can express (4.97) in an 
alternate form: 



HUz-') = ±z- 



= ±z" 



a(N)z'' + a{N - l)z""^ + • • • + a(2)z^ 
+ a(l)z+ 1 

1 + a(l)z-i + a(2)z-2 + ---+a{N- \)z-^^-^^ 
+ a{N)z-^ 

1 + a(l)z + a(2)z2 + ...+a{N- l)z<^-i> "| 
+ a{N)z^ 



1 + a(l)z-i + a(2)z-2 + ---+a{N- 
+ a{N)z-^ 



-(N-l) 



(4.98) 



(4.99) 
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If the denominator of (4.99) is denoted as Z)(z^'), its numerator is D(z), 
which is the mirror image polynomial of D{z~^). Therefore, the allpass filter has 
a transfer function expressed in compact form as 



Diz-') 



H.p(z-') = (4.100) 



When the allpass filter has all its poles inside the unit circle in the z plane, it is 

a stable function and its zeros are outside the unit circle as a result of the mirror 
image symmetry. Therefore a stable, allpass filter function is non-minimum 
function. 

From (4.99), it is easy to see that the magnitude response of H^^ie^'^) is equal 
to one at all frequencies and is independent of all the coefficients: 



\H,r>{.en\ = 



1 + fl(l)e^'^ + a(2)ej^'" + ■■■+ aime-^^"' 



1 + ail)e-j'^ + a(2)e-j^'^ + ■■■+ a{N)e 



—jNoj 



1 (4.101) 



But the phase response (and the group delay) is dependent on the coefficients of 
the allpass filter. We know that the phase response — as defined by (4.6) — of an 
IIR filter designed to approximate a specified magnitude response is a nonhnear 
function of co and therefore its group delay defined by (4.8) is far from a constant 
value. When an allpass filter is cascaded with such a filter, the resulting filter 
has a frequency response Hiiej'^)H^piej'") = |i/i(e^")Hap(e'")| = 
|//i(e-''")| So the magnitude response does not change when the IIR 

filter is cascaded with an allpass filter, but its phase response 0(a)) changes by the 
addition of the phase response (pia)) contributed by the allpass filter. The allpass 
filters Hap(z) are therefore very useful for modifying the phase response (and 
the group delay) of filters without changing the magnitude of a given IIR filter 
H\{z), when they are cascaded with H\ (z). However, the method used to find the 
coefficients of the allpass filter //ap(z) such that the group delay of Hi(z)Haiz) 
is a very close approximation to a constant in the passband of the filter Hi (z) 
poses a highly nonlinear problem, and only computer-aided optimization has 
been utilized to solve this problem. When the allpass filters have been designed 
to compensate for the group delay of the IIR filters that have been designed to 
approximate a specified magnitude oiHy, such that the cascade connection of the 
two filters has a group delay that approximates a constant value, the allpass filters 
are known as delay equalizers. 



4.9 IIR FILTER DESIGN USING MATLAB 

The design of IIR digital filters with Butterworth, Chebyshev I, Chebyshev II, 
and elliptic filter responses, using MATLAB functions, are based on the theories 
of bilinear transformation and analog filters. So they are commonly used to 
approximate the piecewise constant magnitude characteristic of ideal LP, HP, BP, 
and BS filters. The MATLAB function yulewalk is used to design IIR filters 
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with arbitrary magnitude specifications. We will describe all of these functions 
in the following sections. 

The design of IIR filters based on the bilinear transformation consists of two 
steps: (1) estimation of the filter order and (2) computation of the coefficients of 
the numerator and denominator of H(z~^). The design of these filters starts with 
the following specifications: 

1. The passband frequency Wp of the lowpass or highpass filter. It is a two- 
element vector [Wpi Wp2] for the design of a bandpass or bandstop filter, 
where wp2>wpi. 

2. The stopband frequency ws of the lowpass or highpass filter, where Ws >wp 
for the lowpass filter and ws<wp for the highpass filter. Ws is a two- 
element vector [Wsi Ws2] for the bandpass or bandstop filter. We have 
Ws2>wp2>wpi>wsi for the bandpass filter and Wp2>ws2>wsi>wpi for the 
bandstop filter. All of these frequencies are specified within the interval 
[0 1], where 1 represents the Nyquist frequency. 

3. The maximum attenuation Rp (in decibels) in the passband. 

4. The minimum attenuation Rs (in decibels) in the stopband. 

The four functions to estimate the order of the Butterworth, Chebyshev I, Cheby- 
shev n, and elliptic filters are given respectively as 

1. [N,Wn] = buttord(Wp,Ws,Rp,Rs) 

2. [N,Wn] = cheblord(Wp,Ws,Rp,Rs) 

3. [N,Wn] = cheb2ord(Wp,Ws,Rp,Rs) 

4. [N,Wn] = ellipord(Wp,Ws,Rp,Rs) 



where n is the order of the LP and HP filters (2N is the order of the BP and BS 
filters) and wn is the frequency scaling factor. These two variables are then used 
in the four MATLAB functions to get the vectors b = [b(i) b(2) b(3) ... 
b(N+i)] and a = [a(i) a(2) a(3) ... a (N+i) ], for the coefficients of the 
numerator and denominator of H(z~^) in descending powers of z. The constant 
coefficient a ( i ) is equal to unity: 

-K ^ HI) + H2)z-' + b{3)z-^ + ... + biN+ l)z-^ 
^ l+a(2)z-i+a(3)z-2 + ---+a(Af+l)z-^ 

Note that in the function [n , wn] = but tord ( wp , ws , Rp , Rs ) , the value of Rp is 
restricted to 3 dB because the analog prototype lowpass filter chosen to design the 
Butterworth filter obtained under the bilinear transformation uses a 3 dB band- 
width. There are several MATLAB functions available in the Signal Processing 
Toolbox for the design of analog filters — buttap, chebiap, cheb2ap, and 
ellipap — and the functions for implementing the analog frequency transforma- 
tions discussed in this chapter are lp2bp, lp2hp, lp2bp and lp2bs. However, 
we focus on the four MATLAB functions that are available for designing IIR 
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digital filters. They are described below, after we have obtained the order n of 
the IIR filter: 

1. [b,a] = butter(N,Wn) 

2. [b,a] = chebyl (N,Rp,Wn) 

3. [b,a] = cheby2 (N, Rs, Wn) 

4. [b,a] = ellip(N,Rp,Rs,Wn) 

After we have obtained the coefficients of the transfer function, we use the 
function freqz (b, a,No) to get the magnitude response, phase response, and 
group delay response, which can then be plotted. Nq is the number of dis- 
crete frequencies in the interval [0 n] which is chosen by the user. For the 
design of a high pass filter and a bandstop filter, we have to include a string 
'high' and 'stop' as the last argument in the filter functions, for example, 
[b,a] = butter (N,wn, 'high' ) for designing a Butterworth highpass filter 
and [b, a] =cheby2 (N, Rs , Wn, ' stop' ) for designing a Chebyshev II stopband 
filter. In these functions, the value of n and wn are those obtained in the first step, 
as the output variables from the functions for estimating the order of the filter. 
We illustrate the use of these MATLAB functions by a few examples. 

Example 4.11 

%MATLAB script to design a Elliptic Lowpass filter 
% with the specif ications : .Wp = 0.4,Ws = 0.5, Rp = 0.5, 

% Rs = 60 
[N,Wn] =ellipord(0.4, 0.5, 0.5,60); 
[b,a]=ellip(N,0.5,60,Wn) ; 
[h, w] = freqz (b, a, 256) ; 
H=abs (h) ; 
HdB=20*loglO (H) ; 
plot (w/pi , H) ;grid 

title (' Magnitude response of a Elliptic Lowpass filter') 

ylabel ('Magnitude' ) 

xlabel ( 'Normalized frequency' ) 

figure 

plot (w/pi,HdB) ;grid 

title (' Magnitude response of a Elliptic Lowpass filter') 
ylabel ( ' Magnitude in~dB ' ) 
xlabel (' Normalized frequency') 
%end 

The order of this filter is found to be 7, and its magnitude is plotted in 

Figures 4.23 and 4.24. Figure 4.23 shows the equiripple in the passband; Figure 
4.24 shows the equiripple magnitude (in decibels) in the stopband, and the min- 
imum attenuation is seen to be 60 dB. 
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Example 4. 12 

%MATLAB Script to design a Chebyshev I (Equiripple) Bandpass 
% filter with Wsl = 0.25, Wpl = 0.3, Wp2 = 0.4 ,Ws2 = 0.45, 
% Rp = 0.5, Rs = 50 
[N, Wn] =chebyord ( [0 . 3 0.4], [0.25 0.45], 0.5, 50); 
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Magnitude resopnse of a Chebyshev I bandpass filter 
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Figure 4.25 Magnitude response of a Chebyshev I (equiripple) bandpass fiher. 



[b, a] =chebyl (N, 0 . 5 , Wn) 

[h, w] =f reqz (b, a, 256) ; 
H=abs (h) ; 
HdB=20*loglO (H) ; 
plot (w/pi , H) ;grid 

title (' Magnitude response of a Chebyshev I Bandpass filter') 

ylabel ( ' Magnitude ' ) 

xlabel (' Normalized frequency') 

%end 

The order of this filter is found to be 12, and its magnitude response is shown 
in Figure 4.25. 

Example 4. 13 

%MATLAB script to design a Butterworth Bandstop filter 
% with Wpl = 0.18, Wsl = 0.2, Ws2 = 0.205, Wp2 = 0.24, 
% Rp = 0. 5 and Rs = 50 

Wp= [0.18 0 . 24] ; 

Ws= [0.2 0 .205] ; 
[N, Wn] =buttord (Wp, Ws, 0.5,50) ; 
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[b , a] =butter (N, Wn, 'stop' ) ; 

[h,w] =freqz (b, a, 256) ; 
H=abs (h) ; 
plot (w/pi , H) ; grid 

title (' Magnitude response of a Butterworth Bandstop filter') 

ylabel ( ' Magnitude ' ) 

xlabel (' Normalized frequency') 

%end 

The order of this filter is 8, and its magnitude response, shown in Figure 4.26, 
acts Hke a notch filter. It can be used to filter out a single frequency at which 
the attenuation is more than 65 dB. Since this frequency is &) = 0.2, it is 20% 
of the Nyquist frequency or 10% of the sampling frequency. So if the sampling 
frequency is chosen as 600 Hz, we can use this filter to filter out the undesirable 
hum at 60 Hz due to power supply in an audio equipment. 

The coefficients of the digital filter are copied below from the output of the 
MATLAB script shown above: 

b — numerator coefficients (columns 1-9): 

0.9168 -5.9000 17.9049 -32.9698 40.1175 -32.9698 17.9049 
-5.9000 0.9168 



Magnitude response of a Butterworth bandstop filter 
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Figure 4.26 Magnitude response of a Butterworth bandstop filter. 
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a = denominator coefficients (columns 1-9): 

1.0000 -6.2955 18.6910 -33.6739 40.0927 -32.2433 17.1366 
-5.5267 0.8406 

Example 4. 14 

%MATLAB script to design a Chebyshev II highpass filter 
%with Wp=0 . 5 , Ws=0 . 4 , Rp=0 . 5 and Rs=60 

[N, Wn] =cheb2ord(0 . 5, 0.4,0.5,60) 

[b, a] =cheby2 (N, 60 , Wn, ' high' ) ; 

[h, w] =f reqz (b, a, 256) ; 
H=abs (h) ; 
HdB=20*loglO (H) ; 
plot (w/pi , H) /grid 

title (' Magnitude response of a Chebyshev II Highpass Filter') 

ylabel ( ' Magnitude ' ) 

xlabel (' Normalized frequency') 

%end 

The magnitude response of this filter is of order 11, is shown in Figures 4.27 
and 4.28. 
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Figure 4.27 Magnitude response of a Chebyshev 11 highpass filter. 
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Figure 4.28 Magnitude response (in decibels) of a Chebyshev II highpass filter. 



4.10 YULE-WALKER APPROXIMATION 

Now we introduce another function called yulewalk to find an IIR filter that 
approximates an arbitrary magnitude response. The method minimizes the error 
between the desired magnitude represented by a vector d and the magnitude of 
the IIR filter H{e'") in the least-squares sense. 

In addition to the maximally flat approximation and the minimax (Chebyshev 
or equiripple) approximation we have discussed so far, there is the least- squares 
approximation, which is used extensively in the design of filters as well as other 
systems. The error that is minimized in a more general case is known as the 
least-pth approximation. It is defined by 

/3(«) = [ Wie'"") |// (£■'■'") - D{ej'^)\'' dco 

and when p — 2, it is known as the least-squares approximation. In the error 
function shown above, Die'"^) is the desired frequency response and H(e^^) 
is the response of the filter designed, whereas W{e-'") is a weighting function 
chosen by the designer. It has been found that as p approaches oo, the error 
is minimized in the minimax sense, and in practice, choosing p — 4,5,6 gives 
a good approximation to Z)(e^") in the least-/)th sense [14]. It is best to avoid 
sharp transitions in the specifications for the desired magnitude for the IIR filter 
when we use the MATLAB function yulewalk. The function has the form 

[num, den] = yulewalk (N, F, D) 
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where f is a vector of discrete frequencies in the range between 0 and 1 .0, where 
1.0 represents the Nyquist frequency; the vector f must include 0 and 1.0. The 
vector D contains the desired magnitudes at the frequencies in the vector f; hence 
the two vectors have the same length, n is the order of the filter. The coefficients 
of the numerator and denominator are output data in the vectors num and den as 
shown in (4.102). 

Example 4. 15 

%MATLAB script to design a IIR filter using the function 
% yulewalk. 
F=[0 0.3 0.7 0.8 1.0]; 
D=[0 0.8 0.6 0.3 0.5]; 
[num, den] =yulewalk ( 10 , F , D) ; 
[h, w] =f reqz (num, den, 256) ; 
H=abs (h) ; 
plot (w/pi , H) ;grid 

title (' Magnitude of an IIR filter by Yulewallcer 

approximation' ) 
ylabel ( ' Magnitude ' ) 
xlabel (' Normalized frequency') 

The magnitude of the IIR filter of order 10 obtained in this example is shown 
in Figure 4.29. We can increase or decrease the order of the filter and choose the 
design that satisfies the requirements for the application under consideration. 
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Figure 4.29 Magnitude response of an IIR filter, using Yule- Walker approximation. 
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4.11 SUMMARY 



In this chapter, three major topics have been discussed. First, the theory and 
design procedure for approximating the piecewise constant magnitude of ideal 
analog filters was discussed, followed by the theory and design procedure for 
the design of the IIR filters. These are lowpass, highpass, bandpass, or bandstop 
filters that approximate the desired piecewise constant magnitudes in either the 
maximally flat sense or the equiripple sense. It is to be pointed out that the 
constant group delay of analog filters does not transform to a constant group delay 
of the IIR filter obtained by the bilinear transformation. Separate procedures for 
designing IIR filters that approximate a constant group delay have been described 
in [10]. 

Next we described the MATLAB functions that are used for designing these 
IIR filters as well elliptic function filters. Finally we described the use of the 
MATLAB function yulewalk that approximates an arbitrary magnitude response 
in the least-squares sense. Design of IIR filters that approximate given fre- 
quency specifications with additional approximation criteria are described in 
Chapter 7. 



PROBLEMS 

4.1 Find the function \H{jco)\^ from the transfer functions given below: 

5-1-3 



H2{S) = 



s^ + 2s + 2 

s^ + s + l 



s(s^ + 4s +20) 

4.2 Find the transfer function H{s) from the functions given below: 



^i(»l' = T^^^^TT^^ (4-103) 



(co^ + 9) 
(cw2 + 4)(ft)2 + i) 



, (tt>2 + 4) 

= , 2 4^u (4.104) 

{co'^ + 16)(a)^ -I- 1) 

4.3 An analog signal x(t) = e~^'u(t) is sampled to generate the discrete- 
time sequence x{nT) = e~'^"^u{n). Find the z transform X{z) of the DT 
sequence for T = 0.1, 0.05, 0.01 s. 

4.4 An analog signal jc(f) = 10cos(2f)M(0 is sampled to generate the discrete- 
time sequence x(nT) = 10 cos(2nT)u(n). Find the z transform X{z) of 
the DT sequence for T = 0.1, 0.01 s. 

4.5 Derive transfer function Hi (z) obtained when the impulse-invariant trans- 
formation is applied and H2iz) when the bilinear transformation s = 
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2\(z — l)/(z+ 1)] is applied to the transfer function H(s) = l/(^^ + 
V2s +1). Simplify the transfer functions as the ratio of polynomials in z. 

Find the z transform obtained by the impulse-invariant transformation of 
H(s) given below, assuming T = 0.1 s: 



sis+l)(s + 3) 

(^+1) 
is + 2)(s^ + 2s + 5) 

s(s^ + As + 10) 
is + 5)(s^ + 6s+ 15) 



By application of the impulse-invariant transformation of H{s), the follow- 
ing transfer functions have been obtained. Find H{s), assuming T = 0.1 s: 



Hiiz) = 
Hiiz) = 

H3{Z) = 
H4iz) = 



2z 



(z-e-''-2)(z-e-0-i) 

0.6 



z - e 



iz - e-0-5)(z - e-O-4) 
z 

iz - 0.9)(z - 0.3) 

z 

iz - 0.4) (z - 0.8) 



The following transfer functions of a digital filter are obtained by applying 
the bilinear transformation on analog transfer functions His). Derive the 
transfer functions His), assuming r = 0.1 s: 



Hiiz) = 
Hiiz) = 
Hiiz) = 



z + l 



z^ + z + 6 

z + 4- 
z^ + 6z + 8 

2z + 5 

z^ + 2z + 2 



9 Find the magnitude (in decibels) at the frequency cOs = 1000 rad/s of 
a Fourth-order Chebyshev I highpass, analog filter with the magnitude 
response shown in Figure 4.30. 

10 A Chebyshev I bandstop analog filter is to be designed to approximate 
the following specifications: copi = 10"* and cOpj = 7 x lO'* are the cutoff 
frequencies of the passband. Passband ripple = 0.5 dB, co^i = 2 x 10^ is a 
frequency in the stopband and the minimum attenuation in the stopband = 
30 dB. What is the stopband frequency and the order of the lowpass 
prototype filter Hip)! 



242 



INFINITE IMPULSE RESPONSE FILTERS 



|H(yco)|dB 




Figure 4.30 Problem 4.9. 
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Figure 4.31 Problem 4. 1 1 . 



4.11 What is the order of an analog bandpass Chebyshev I filter that has a 
magnitude response as shown in Figure 4.31? 

4.12 Determine the sampling period T such that a frequency i = 7 15 of the 
analog filter maps to the normalized frequency m — Q3n of the digital 
filter. 

4.13 A digital Butterworth lowpass filter is designed by applying the bilinear 
transformation on the transfer function of an analog Butterworth low- 
pass filter that has an attenuation of 45 dB at 1200 rad/s. What is the 
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frequency in rad/s at which the digital filter has an attenuation of 45 dB, 
if its sampling frequency is 1000 Hz? 

4.14 A digital Chebyshev bandpass filter is designed by applying the bilinear 
transformation on the transfer function of an analog Chebyshev bandpass 
filter that has a bandwidth of 200 rad/s between 1400 and 1600 rad/s. 
What is the bandwidth of the digital filter, if its sampling frequency is 



4.15 A Butterworth bandpass IIR digital filter designed by using the bilinear 
transformation has a magnitude response as shown in Figure 4.32. Find 
the order of the filter. 

4.16 An IIR lowpass Butterworth filter is to be designed, using the bilinear 
transformation, with a cutoff frequency Mc — O.Btt at which the maximum 
attenuation is 0.5 dB. The minimum attenuation at the stopband cutoff 
frequency cos — 0.8n is 40 dB. Find the transfer function H{p) of the 
lowpass prototype filter, when the bilinear transformation is used. 

4.17 Find the magnitude of a lowpass Butterworth IIR filter at the frequency 
(O.Stt). The order of the filter is 10, the sampling frequency is 10^ Hz, 
and the 3 dB bandwidth of the filter is (0.27r). 

4.18 What are the frequencies cl)s2 and cosi at which the lOth-order Butterworth 
analog bandpass filter has a magnitude of 0.045? The filter has a magnitude 
response as shown in Figure 4.33. 

4.19 What is the order of a Chebyshev bandpass IIR filter that has a magnitude 
response such as that shown in Figure 4.34. 
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Figure 4.32 Problem 4.15. 
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Figure 4.33 Problem 4.18. 




4.20 Design a Chebyshev analog highpass filter that approximates the specifi- 
cations as shown in Figure 4.35. 

4.21 Design a Butterworth bandpass IIR filter that approximates the specifica- 
tions given in Figure 4.36. Show all calculations step by step. Plot the 
magnitude using MATLAB. 

4.22 A Butterworth bandpass IIR filter of order 10 meets the following spec- 
ifications: CLipi — O.Stt, CL>p2 — 0.657r, cl)s2 — O.Sn, Ap — 0.5 dB. What is 
the attenuation at ccsi'^ 

4.23 A Chebyshev I bandstop digital filter meets the satisfy the following spec- 
ifications: a>pi — O.ln, cDp2 — O.^TT, a>s2 — OAjt, ap — 0.8, as — 55. Find 
the transfer function H(p) of the lowpass analog prototype filter. 
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Figure 4.35 Problem 4.20. 
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Figure 4.36 Problem 4.21. 



4.24 A Butterworth highpass digital filter has a passband cutoff frequency of 
1500 Hz, a stopband cutoff frequency of 650 Hz, a passband attenuation 
of 2.0 dB, and a stopband attenuation of 45 dB. The sampling period 
is 0.2 X 10~^ s. Find the transfer function H(p) of the lowpass analog 
prototype filter. 

4.25 Design a bandpass Chebyshev I IIR filter that approximates the specifica- 
tions as shown in Figure 4.37. Show all calculations step by step, assuming 
a sampling frequency fs — 1000 Hz. Plot the magnitude using MATLAB. 

4.26 Obtain the transfer function of the Butterworth lowpass IIR filter with ccp — 
OAtt, Ms — 0.9ji, Rp — 0.5, Rs — 20. Using the digital spectral transforma- 
tion LP-HP, find the transfer function of the highpass filter with a cutoff 
frequency of 0.757r. 



246 



INFINITE IMPULSE RESPONSE FILTERS 



1.00 
0.92 




X(z) 



Figure 4.37 Problem 4.25. 
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Figure 4.38 Problem 4.27a. 
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Figure 4.39 Problem 4.27b. 



4.27 Derive the transfer function of the two circuits shown in Figures 4.38 and 
4.39 and verify that they are allpass filters. 

4.28 The transfer function of an analog allpass filter H{s) — (s^ — as + b)/ 
{s^ + as + b) has a magnitude response equal to one at all frequencies. 
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Show that the IIR filter obtained by the application of the bilinear trans- 
formation on H{s) is also an allpass digital filter. 

MATLAB Problems 

4.29 Design a Butterworth bandstop filter with Wpi = 0.2, W,i = 0.35, Ws2 = 
0.55, Wp2 = 0.7.0, Rp = 0.25, and Rs = 45. Plot the magnitude and the 
group delay response. 

4.30 Design a Chebyshev I bandpass filter to meet the following specifications: 

W,i = 0.4, Wpi = 0.45, Wp2 = 0.55, W,2 = 0.6, Rp = 0.3, R, = 50. Plot 
the magnitude (in decibels) and the group delay to verify that the given 
specifications have been met. 

4.31 Design a Chebyshev II highpass filter with Ws = 0.1, Wp = 0.3, Rp = 0.8, 
7? 5 = 60 dB. Plot the magnitude (in decibels) and the group delay of the 
filter to verify that the design meets the specifications. 

4.32 Design an elliptic lowpass filter with Wp = 0.2, W, = 0.35, Rp = 0.8, 
R^ = 40. Plot the magnitude (in decibels) and the group delay of the 
filter. 

4.33 Design an elliptic lowpass filter with Wpi = 0.3, W,, = 0.4, Rp = 0.5, 
Rs = 55. Plot the magnitude (in decibels) and the group delay of the 
filter. Plot a magnified plot of the response in the stopband to verify that 
the specifications have been met. 

4.34 Design a Butterworth bandpass filter with Wvi = 0.3, Wpi = 0.5, Wp2 = 
0.55, Ws2 = 0.8, Rp = 0.5, and Rs = 50. Plot its magnitude and phase 
response. 

4.35 Design an IIR filter with the following specifications: F = [0 0.2 0.4 
0.5 1.0], Z) = [I.O 0.5 0.7 0.9 1.0], using yulewalk function. 
Plot the magnitude of the filter. 

4.36 Design an IIR filter with the following specifications, using the MATLAB 
function yulewalk: F = [0.0 0.3 0.5 0.7 0.9 I.O]; D = [0.2 
0.4 0.5 0.3 0.6 I.O]. Plot the magnitude of the filter. 

4.37 Design an IIR filter that approximates the magnitude response with the 
specifications F = [0.0 0.2 0.4 0.6 0.8 1.0]; D = [1.0 0.18 
0.35 0.35 0.18 1.0] using the MATLAB function yulewalk. Plot 
the magnitude and group delay response of the filter. 
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CHAPTER 5 



Finite Impulse Response Filters 



5.1 INTRODUCTION 

From the previous two chapters, we have become famiUar with the magnitude 
response of ideal lowpass, highpass, bandpass, and bandstop filters, which was 
approximated by IIR filters. In the previous chapter, we also discussed the theory 
and a few prominent procedures for designing the IIR filters. 

The general form of the difference equation for a linear, time-invariant, 
discrete-time system (LTIDT system) is 

N M 

y(n) = - ^aik)yin - k) + ^b{k)x{n - k) (5.1) 

The transfer function for such a system is given by 

^ _i ^ bo + b{l)z-' + b(l)z-^ + ■■■ + b{M)z-'' 

' 1 + a(l)z-i + a(2)z-2 + a(3)z-3 + • • • + a{N)z-^ 

The transfer function of an FIR filter, in particular, is given by 

H{z-') = bo + bil)z-^ + b{2)z-^ + ■■■ + b{M)z-'' (5.3) 
and the difference equation describing this FIR filter is given by 

M 

y{n) = Y^b{k)x{n-k) (5.4) 

*:=0 

= b{Qi)x{n) + b{\)x{n - 1) -|- • • • -|- b{M)x{n - M) (5.5) 

In this chapter, the properties of the FIR filters and their design will be dis- 
cussed. When the input function x{n) is the unit sample function 5(«), the 
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output y(n) can be obtained by applying the recursive algorithm on (5.4). We 
get the output y{n) due to the unit sample input S(n) to be exactly the values 
b(0), b(l), b{2), b(3), . . . , b(M). The output due to the unit sample function S(n) 
is the unit sample response or the unit impulse response denoted by /z(n). So 
the samples of the unit impulse response h{n) = b(n), which means that the unit 
impulse response h(n) of the discrete-time system described by the difference 
equation (5.4) is finite in length. That is why the system is called the finite impulse 
response filter or the FIR filter. It has also been known by other names such as 
the transversal filter, nonrecursive filter, moving-average filter, and tapped delay 
filter. Since h{n) = b(n) in the case of an FIR filter, we can represent (5.3) in 
the following form: 

M 

H{z-^) = J2 h{k)z-^ = hiO) + hil)z-^ + h{2)z-^ + ■■■ + h{M)z-^^^ (5.6) 

k=0 

The FIR filters have a few advantages over the IIR filters as defined by (5.1): 

1. We can easily design the FIR filter to meet the required magnitude response 
in such a way that it achieves a constant group delay. Group delay is defined 
as T = —{dO/dco), where 0 is the phase response of the filter. The phase 
response of a filter with a constant group delay is therefore a linear function 
of frequency. It transmits all frequencies with the same amount of delay, 
which means that there will not be any phase distortion and the input signal 
will be delayed by a constant when it is transmitted to the output. A filter 
with a constant group delay is highly desirable in the transmission of digital 
signals. 

2. The samples of its unit impulse response are the same as the coefficients 
of the transfer function as seen from (5.5) and (5.6). There is no need to 
calculate h{n) from H{z^^ ), such as during every stage of the iterative opti- 
mization procedure or for designing the structures (circuits) from H{z~^). 

3. The FIR filters are always stable and are free from limit cycles that arise 
as a result of finite wordlength representation of multiplier constants and 
signal values. 

4. The effect of finite wordlength on the specified frequency response or the 
time-domain response or the output noise is smaller than that for IIR filters. 

5. Although the unit impulse response h{n) of an IIR filter is an infinitely 
long sequence, it is reasonable to assume in most practical cases that the 
value of the samples becomes almost negligible after a finite number; thus, 
choosing a sequence of finite length for the discrete-time signal allows us 
to use powerful numerical methods for processing signals of finite length. 

5.1.1 Notations 

It is to be remembered that in this chapter we choose the order of the FIR 
filter or degree of the polynomial H{z~^) = Xl^o^(")^" length 
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of the filter equal to the number of coefficients in (5.6) is + 1. If we are 
given H(z~^) = 03z~* + 0.1z~^ + 0.5z~^, its order is 6, although only three 
terms are present and the correct number of coefficients equal to the length of 
the filter is 7, because h(0) = h(l) = h(2) = h(3) = 0. It becomes necessary to 
point out the notation used in this chapter, because in some textbooks, we may 
find H(z~^) — "^^=0 h(n)z~" representing the transfer function of an FIR filter, 
in which case the length of the filter is denoted by N and the degree or order 
of the polynomial is (A^ — 1). (Therefore students have to be careful in using 
the formulas found in a chapter on FIR filters, in different books; but with some 
caution, they can replace that appears in this chapter by (A^ — 1) so that the 
formulas match those found in these books.) 

The notation often used in MATLAB, is H(z~^) ^ h(l) + hi2)z~^ + 

h(3)z~'^ -\ + h(N + l)z~^, which is a polynomial of degree A^, and has 

(A^ + 1) coefficients. In more compact form, it is given by 



The notation and meaning of angular frequency used in the literature on discrete- 
time systems and digital signal processing also have to be clearly understood by 
the students. One is familiar with a sinusoidal signal x{t) = A sin(wO in which 
w = 27r/ is the angular frequency in radians per second, / is the frequency in 
hertz, and its reciprocal is the period Tp in seconds. So we have w = 27t/Tp 
radians per second. Now if we sample this signal with a uniform sampling 
period, we need to differentiate the period Tp from the sampling period denoted 
by Tg. Therefore, the sampled sequence is given by xinT^) = A^m{ymTs) = 
Asm(2nnTs/Tp) = Asm{2jTf/fs) = Asin(w//^). The frequency w (in radians 
per second) normalized by fs is almost always denoted by co and is called the 
normalized frequency (measured in radians). The frequency w is the analog fre- 
quency variable, and the frequency a> is the normalized digital frequency . On 
this basis, the sampling frequency cog = 2n radians. Sometimes, w is normalized 
by nfs or 27r/s so that the corresponding sampling frequency becomes 2 or 1 
radian(s). Note that almost always, the sampling period is denoted simply by T 
in the literature on digital signal processing when there is no ambiguity and the 
normalized frequency is denoted by « = v/T . The difference between the angular 
frequency in radians per second and the normalized frequency usually used in 
DSP literature has been pointed out in several instances in this book. 



5.2 LINEAR PHASE FIR FILTERS 

Now we consider the special types of FIR filters in which the coefficients h{n) 
of the transfer function H{z~^) = X!^=o''(")^" assumed to be symmetric 
or antisymmetric. Since the order of the polynomial in each of these two types 



N 




(5.7) 
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can be either odd or even, we have four types of filters with different properties, 
which we describe below. 

Type I. The coefficients are symmetric [i.e., h{n) — h{N — «)], and the order 
is even. 



Example 5. 1 

Let us consider a simple example: 

Hiz-^) = h{0) + h{l)z~'^ + h(2)z~^ + /i(3)z-' + h(4)z~'^ 
+ /j(5)z-5 + /j(6)z-^ 

As shown in Figure 5.1a, for this type I filter, with N = 6, we see that h(0) = 
h(6), h{l) — h{5), h{2) — h(4). Using these equivalences in the above, we get 



H{z-^) = /j(0)[l + z"^] + /J(l)[z-' + z"^] + h(2)[z-^ + z"^] + hi3)z-^ 



(5.8) 



This can also be represented in the form 

H(z-i) = z"^ {/J(0)[z^ + z"^] + h{l)[z^ + z-2] + h{2)[z + z"'] + h(3)} 



(5.9) 
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Figure 5.1 Unit impulse responses of the four types of linear phase FIR filters. 
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Let US evaluate its frequency response (DTFT): 

Hie-j"') = e'j^'^ {2/1(0) cos(3a)) + 2;!(1) cosilco) + 2h(2) cos(cw) + h(3)} 

The expression Hr{co) in this equation is a real- valued function, but it can be 
positive or negative at any particular frequency, so when it changes from a 
positive value to a negative value, the phase angle changes by n radians (180°). 
The phase angle 6{a)) — —3co is a linear function of co, and the group delay r is 
equal to three samples. Note that on the normalized frequency basis, the group 
delay is three samples but actual group delay is ST seconds, where T is the 
sampling period. 

In the general case, we can express //(e-'") in a few other forms, for example 



//(e>) = ^/z(n)e-> 



n=0 



= ^(0) + h(l)e--"" + h(2)e-J'^'^ + ■ ■ ■ + h(N - l)e 



-UN CO) 



= e-^«^/2)'"5 j2/i(0)cos 



+ 2h{2) cos ( ( y - 2 I ft) ) H \-h 



m 



(5.10) 



We put it in a more compact form: 



N 
2 



cos(nftj) 



= e^'^<"UHi?(«)} 



(5.11) 

The total group delay is a constant = N /2 in the general case, for a type I FIR 
filter. 

Type II. The coefficients are symmetric [i.e., h{n) = h{N — n)], and the order 
A'^ is odd. 

Example 5.2 



Here we consider an example in which the coefficients are symmetric but N = 1, 
as shown in Figure 5.1b. For this example, we have 

//(z-i) = ^(0) + h{\)z-^ + h{2)z-^ + hO)z-^ + h{A)z-^ + h{5)z-^ 
+ h{6)z-^ + h{l)z-^ 
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and because of symmetry 

h(0) = hi7), hil) = hi6), h{2) = h(5), h(3} = hi4). 
Therefore 

Hiz-^) = /j(0)[l + z"^] + hil)[z-^ + z"*'] + /i(2)[z-2 + z"^] 
+ /i(3)[z-3+z-4] 

The frequency response is given by 

H{e~^'") = [2h(0) cos(3.5(w) + 2h(l) CDs(2.5ft;) 

+ 2h(2) cos(1.5a)) + 2/1(3) cos(0.5(d)} 

The phase angle ^(tw) = —3.5ft), and the group delay is t = 3.5 samples. 
In the general case of type II filter, we obtain 



Hie-n = J2hin)e-j'"' = eJ^^"^ {//«(ft>)} 



n=0 



(^+1)72 



E 



n=l 



+ 1 



cos I n — - ) «) 



(5.12) 



which shows a Unear phase 0{co) = —[(N/2)q)] and a constant group delay = 
N/2 samples. 

Type III. The coefficients are antisymmetric [i.e., h(n) = —h{N — n)], and the 
order N is even. 



Example 5.3 

We consider an example of type 111 FIR filter of order N — 6 and as shown in 
Figure 5.1c, we have /i(0) = —h{6), /i(l) = —h{5), h{2) = —h{4) and we must 
have h{3) = 0 to maintain antisymmetry for these samples: 

/f(z-i) = hmi - z-^] + /J(l)[z-' - z"^] + /z(2)[z-2 - z-4] (5.13) 
= z"^ {hiO)[z^ - z"^] + /i(l)[z^ - z"^] + /i(2)[z - z"^]} (5.14) 
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Now if we put z = and e-'" — e ■''*' = 2j sin(ctf) = le^'^^l'^'i sin(a)), we arrive 
at the frequency response for this filter as 



H(e~j'^) = e"'^" {h(0)2j sin(3co) + hil)2j sm{2a)) + h(2)2j sm(a))} (5.15) 
= e-^'^'^e'^^/^' {2/!(0) sin(3ft)) + 2/i(l) sin(2ft>) + 2/1(2) sin(a))} (5.16) 



(5.17) 



Note that the phase angle for this filter is 0{o}) = — 3tw + 7r/2, which is still a 
linear function of co. The group delay is t = 3 samples for this filter. 
In the general case, it can be shown that 



-j[(Nco-7t)/2] 



N/2 
n=l 



sin(nft;) 



(5.18) 



and it has a linear phase 6{co) = —[(Nco — n)/2] and a group delay r = N/2 
samples. 

Type IV. The coefficients are antisymmetric [i.e., h{n) = —h(N — n)], and the 
order is odd. 

Example 5.4 

We consider an example of type IV filter with N — 1 as shown in Figure 5. Id, in 
which h(0) = -h{l), h(l) = -h(6), h{2) = -h(5), /i(3) = -h(4). Its transfer 
function is given by 

Hiz-^) = hmi - z~^] + Hl)[z-^ - z-^] + h{2)[z-^ - 

+ /i(3)[z-3-z-4] (5.19) 



The frequency response can be derived as 

J2.5a} _ g-;2.5£0^ 
,./1.5« _ g-il.5«-| _^ /j(3)[e70.5<« _ g-j0.5«-| 

= e-^^-^'^{h{Q)2i sin(3.5ftj) + /j(l)2y sin(2.5(w) + /j(2)2j sin(1.5ft;) 

+ /z(3)2ysin(0.5«)} 
= e-i^^-^'^-^'''^^\2h{Q) sin(3.5w) + 2h{\) sin(2.5ft;) + 2h{2) sin(1.5ft;) 



+ 2/j(3) sin(0.5(w)} 



(5.20) 
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This type IV filter witli N = 1 has a linear phase 6{(o) = — 3.5tt> + njl and a 
constant group delay x = 3.5 samples. 

The transfer function of the type IV linear phase filter in general is given by 



-;[(JV<w-7r)/2] 



(iV+l)/2 

2 ^ h 

n=l 



N + \ 



sm I \ n — — \ CO 



(5.21) 

The frequency responses of the four types of FIR filters are summarized below: 



-j[(NI2)io] 



^ ^ n=l 



cos(na)) 



(W+l)/2 

2 ^ /. 

n=l 



- n 



for type I 



cos I [ n — -] CO 



N/2 



N 



sm(nco) 



for type II 



for type III 



-j\{Nco-n)l2\ 



(iV+l)/2 

2 ^ 

«=1 



7V+ 1 



sm I I n — - 1 a> 



for type IV (5.22) 



5.2.1 Properties of Linear Phase FIR Filters 

The four types of FIR filters discussed above have shown us that FIR filters 
with symmetric or antisymmetric coefficients provide linear phase (or equiva- 
lently constant group delay); these coefficients are samples of the unit impulse 
response. It has been shown above that an FIR filter with symmetric or anti- 
symmetric coefficients has a linear phase and therefore a constant group delay. 
The reverse statement, that an FIR filter with a constant group delay must have 
symmetric or antisymmetric coefficients, has also been proved theoretically [4]. 
These properties are very useful in the design of FIR filters and their applica- 
tions. To see some additional properties of these four types of filters, we have 
evaluated the magnitude response of typical FIR filters with linear phase. They 
are shown in Figure 5.2. 

The following observations about these typical magnitude responses will be 
useful in making proper choices in the early stage of their design, as will be 
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Figure 5.2 Magnitude responses of the four types of linear phase FIR filters. 



explained later. For example, type I filters have a nonzero magnitude at = 0 and 
also a nonzero value at the normalized frequency co/jt — 1 (which corresponds to 
the Nyquist frequency), whereas type II filters have nonzero magnitude at ca — 0 
but a zero value at the Nyquist frequency. So it is obvious that these filters are 
not suitable for designing bandpass and highpass filters, whereas both of them 
are suitable for lowpass filters. The type III filters have zero magnitude at m — 0 
and also at cD/:/r = 1, so they are suitable for designing bandpass filters but not 
lowpass and bandstop filters. Type IV filters have zero magnitude at co — 0 and 
a nonzero magnitude at co/n — 1. They are not suitable for designing lowpass 
and bandstop filters but are candidates for bandpass and highpass filters. 

In Figure 5.3a, the phase response of a type I filter is plotted showing the 
linear relationship. When the transfer function has a zero on the unit circle in 
the z plane, its phase response displays a jump discontinuity of n radians at the 
corresponding frequency, and the plot uses a jump discontinuity of In whenever 
the phase response exceeds ±7r so that the total phase response remains within 
the principal range of ±7r. If there are no jump discontinuities of n radians, 
that is, if there are no zeros on the unit circle, the phase response becomes a 
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continuous function of to when it is unwrapped. The result of unwrapping the 
phase (Fig. 5.3a) is to remove the jump discontinuities in the phase response 
such that the phase response lies within ±7r (Fig. 5.3b). If the order A'^ of the 
FIR filter is even, its group delay is an integer multiple of samples equal to N/2 
samples. If the order is odd, then the group delay is equal to (an integer plus 
half) a sample. We will use all of these properties before we start the design of 
FIR filters with linear phase. 

The linear phase FIR filters have some interesting properties in the z plane 
also. As seen in the examples, their transfer functions always contain pairs of 
terms such as [z" ± z~"^ ■ Denoting the transfer function of the FIR filters with 
symmetric coefficients by H{z), we write 

N N 

Hiz) ^^Hn)z~" ^^h(N -n)z~'' (5.23) 

«=0 n=0 

By making a change of variable m — (N — n), we reduce the series 'Yln=o ~ 
n)z~" to 

N N 

J2 h{m)z-^+'" = z"^ ^ A(m)z" = z'^Hiz-^) (5.24) 

m=0 m=0 



SO we have the following result: 

H(z) = z-'^Hiz-') 



(5.25) 
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Similarly, the FIR filters with antisymmetric coefficients satisfy the property 

H{z) = -z~^H(z-i) (5.26) 

A polynomial Hix) satisfying (5.25) is called a mirror image polynomial , and 
the polynomial that satisfies (5.26) is called an anti-mirror image polynomial. 
We see that a polynomial H{z) that has symmetric coefficients is a mirror image 
polynomial and one with antisymmetric coefficients is an anti-mirror image 
polynomial. The reverse statement is also true and can be proved, namely, that 
a mirror image polynomial has symmetric coefficients and an anti- mirror image 
polynomial has antisymmetric coefficients. 

From (5.25) and (5.26), it is easy to note that in a mirror image polynomial 
as well as an anti-mirror image polynomial, if z — z\ is a zero of H{z), then 
1/z is also a zero of H{z). If the zero zi is a complex number rie'"^; |r| < 1, 
then z\ — r\e~^'^ is also a zero. Their reciprocals {\/r\)e~^'^ and {\/r\)e^'^ are 
also zeros of H{z), which lie outside the unit circle |z| — 1. Therefore complex 
zeros of mirror image polynomials and anti-mirror image polynomials appear 
with quadrantal symmetry as shown in Figure 5.4. If there is a zero on the unit 
circle (e.g., at zo — e''*), its reciprocal z~' — e~''^ is already located on the unit 
circle, as the complex conjugate of zo, and therefore zeros on the unit circle do 
not have quadrantal symmetry. Obviously a zero on the real axis at z, — r inside 
the unit circle will be paired with one outside the unit circle on the real axis at 
z;' = l/r. 
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Figure 5.4 Zero and pole locations of a mirror image polynomial. 
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Example 5.5 

We consider the example of a type I FIR filter with H(z~^) = 0.4 + 0.6z~' + 
0.8z"2 + 0.2z~^ + 0.8z~'^ + 0.6z"^ + 0.4z"^, to illustrate these properties. When 
it is expressed in the form Hiz) = z"^[0.4 + 0.6z + O.Sz^ + 0.2z^ + O.&z"^ + 
0.6z^ + 0.4z^] and factorized, we get 



^ , , (z - zi)(z - Zi)(z - z )(z-z )(z - Z2)iz - Z2) 

H(z) = T (5.27) 

where zi = 0.69eJ^^^-^° , z* = 0.69^-^128.6°^ z^^ = lASe'j^^^-^" , z^^* = 
1 45g;i28.6°^ Z2 = e-''54i2°, and Zj^* = e-j^'^-^^° . They are plotted in Figure 5.4 



along with the six poles of H(z) at z = 0. The two zeros at zi and Z2 are on the 
unit circle, and the other four zeros form a quadrantal symmetry in this plot. The 
magnitude of this type I filter is illustrated in Figure 5.2a, which shows that the 
magnitude has zero value at the two frequencies corresponding to the two zeros 
at Z2 and Z2 that are on the unit circle. In Figure 5.3, the phase response also 
shows discontinuities at these two frequencies. 

Some additional properties of the four types of FIR filters are listed below: 

1. Type I FIR filters have either an even number of zeros or no zeros at z = 1 
and z = — 1 . 

2. Type II FIR filters have an even number of zeros or no zeros at z = 1 and 
an odd number of zeros at z = —1. 

3. Type III FIR filters have an odd number of zeros at z = 1 and z = — 1. 

4. Type IV FIR filters have an odd number of zeros at z = 1 and either an 
even or odd number of zeros at z = — 1. 

These properties confirm the properties of the magnitude response of the filters 
as illustrated by Figure 5.2. A zero at z = 1 corresponds to = 0, and a zero 
at z = — 1 corresponds to o) = tt. As an example, we note that the type III FIR 
filter has zero magnitude at « = 0 and « = 1, whereas we stated above that the 
transfer function of the type III FIR filter has an odd number of zeros both at 
z = 1 and z = —1. 

Another important result that will be used in the Fourier series method for 
designing FIR filters is given below. This is true of aU FIR as well as IIR 
filters and not just linear phase FIR filters. The Fourier transform (DTFT) of any 
discrete-time sequence x{n) is 




(5.28) 



n=— 00 
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Since Hie-''") is a periodic function with a period of 2jt, it has a Fourier series 
representation in the form 



Comparing (5.28) and (5.29), we see that x{n) = c(n) for — oo < n < oo. 
When we consider the frequency response of the LTI-DT system H(e-''") = 
J21Z^ h(n)e-j'"'\ where h(n) = 0 for n < 0, we will find that c(n) = 0 for 
n < 0. So we note that the Fourier series coefficients c(n) evaluated from (5.30) 
are the same as the coefficients h{n) of the IIR or FIR filter. Evaluating the 
coefficients c(n) = h(n) by the integral in the Equation (5.30) is easy when we 
choose //(e-'™) to be a constant in the subinterval within the interval of inte- 
gration [— TT, 7t] with zero phase or when H{e^'^) is piecewise constant over 
different disjoint passbands and stopbands, within [—n, tt]. This result facili- 
tates the design of FIR filters that approximate the magnitude response of ideal 
lowpass, highpass, bandpass, and bandstop filters.^ The Fourier series method 
based on the abovementioned properties of FIR filters for designing them is 
discussed next. 



5.3 FOURIER SERIES METHOD MODIFIED BY WINDOWS 

The magnitude responses of four ideal classical types of digital filters are shown in 
Figure 5.5. Let us consider the magnitude response of the ideal, desired, lowpass 
digital filter to be //Lp(e^"'), in which the cutoff frequency is given as coc. It has 
a constant magnitude of one and zero phase over the frequency \(i>\ < coc. From 
(5.30), we get 




(5.29) 



«=— 00 



where 




(5.30) 





sin(£Wcn) 



(5.31) 



= — oo < n < oo 



'Two other types of frequency response for which the Fourier series coefficients have been derived 
are those for the Hilbert transformer and the differentiator. Students interested in them may refer to 
other textbooks. 
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Figure 5.5 Magnitude responses of four ideal filters. (Reprinted from Ref. 9, with per- 
mission from John Wiley & Sons, Inc.) 



Another form for the Fourier series coefficients is 
sin(ft)c«) /Wc^ 



CLp(n) 



\^ — j sinc(ftjc«); — oo < « < oo 



(5.32) 



Note that sinc(cL>fn) — 1 when n — 0, so we find another way of listing the 
coefficients as 



clp(«) 



7T 

sin(ft;cM) 
Tin 



n = 0 

\n\ > 0 



(5.33) 



The Fourier series coefficients for the ideal HP, BP, and BS filter responses 
shown in Figures 5.5b-d can be similarly derived as follows: 



CHp(n) = 



CBp(n) = 



CBs(n) = 



CO,- 

1 -; « = 0 

7T 



sin(c«cn) 
Tin 

(L>c2 — (t)c\ 



\n\ > 0 



« = 0 



n 



1 

— [sin(ft;c2n) — sin(c(;ci«)]; |n| > 0 
nn 



{q)c2 -a>ci) 



« = 0 



(5.34) 



(5.35) 



(5.36) 



— \%m{oL>c\n) — sin(ft)c2n)]; \n\ > 0 
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Continuing with the design of the lowpass filter, we choose the finite series 
J21Z-M cwin)e-j'"" = 7/M(e^''"), which contains (2M + 1) coefficients from -M 
to M, as an approximation to the infinite series l]"=!!°oo CLp(«)e~'"". In other 
words, we approximate the ideal frequency response that exactly matches the given 
HLpie^") containing the infinite number of coefficients by Huie^'^), which con- 
tains a finite number of coefficients. As M increases, the finite series of HM{e^'^) 
approximates the ideal response H^pie^'") in the least mean-squares sense; that is, 
the error defined as 



1 r 



HM{en-HMen\ dco 



(5.37) 



In ^f-^ \ nn J 



dco 



attains a minimum at all frequencies, except at points of discontinuity. 

We can make the error shown above as small as we like by choosing M 
as large as we wish. As M increases, the number of ripples in the passband 
(and the stopband) increases while the width between the frequencies at which 
the maximum error occurs in the passband (0 < co < coc) and in the stopband 
{coc < M < n) decreases. In other words, as M increases, the maximum deviation 
from the ideal value decreases except near the point of discontinuity, where the 
error remains the same, however large the value of M we choose! The maximum 
error or the overshoot from the ideal passband value or the stopband value is 11% 
of the difference between the ideal passband value that is normalized to 1 and 
the stopband value as shown in Figure 5.6. The magnitude response |i/M(e^^)| 
is plotted for two different values of M in Figure 5.6, where Hii{co) is the ideal 
magnitude response of the lowpass filter as shown in Figure 5.5a. 



5.3.1 Gibbs Phenomenon 

These are some of the features of what is known as the "Gibbs phenomenon," 
which was mathematically derived by Gibbs. We explain it qualitatively as fol- 
lows. The finite sequence c(n); —M <n<M can be considered as the result 
of multiplying the infinite sequence c(n); — oo<n<oo by a finite window 
function: 

f 1; -M <n< M 

So we have the product /i«,(n) = c(n) ■ WR(n), which is of finite length as shown 
in Figure 5.7(c). Therefore the frequency response of the product of these two 



264 



FINITE IMPULSE RESPONSE FILTERS 



I 




Figure 5.6 Frequency response of a lowpass filter, showing Gibbs overshoot. (Reprinted 
from Ref. 9, with permission from John Wiley & Sons, Inc.) 
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Figure 5.7 Coefficients of the FIR filter modified by a rectangular window function. 
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functions is obtained from the convolution of *(e^") with the frequency response 
HLpie^") of the ideal, desired, frequency response. 

f^Mien^^j H^p{ej'^)^(e'^''-'^^)dcp (5.40) 

The mainlobe of ^(e'"), centered at cd = 0, has a width defined by the first 
zero crossings on either sides of cd = 0, which occur when [(2M + = ±7r, 
that is, when co — 2ti{2M + 1) so that the width of the mainlobe is 47r/(2M +1). 
As M increases, the width of the mainlobe and the sidelobes decreases, giving 
rise to more sidelobes or ripples in the same frequency band. At the same time, 
the peak amplitudes of the mainlobe and the sidelobes increase such that the 
area under each lobe remains constant. These features of ^(e^"') directly reflect 
on the behavior of HM{e'") when it is convolved with Hippie-''''). The effect 
of convolution between i/Lp(e'™) and *(e^") is illustrated by looking at the 
overlapping interval over which the product /fLp(e''')*(e^*"~'^') is integrated, 
for four different values of co, in Figure 5.8. It is obvious that if the width of the 
mainlobe is extremely narrow, the resulting Huie^'^) will have a sharp drop at 
fy) = (jL)c- If the number of sidelobes or their peak values in *(e'™) increases, so 
also will the number of ripples and the maximum error in Hmie-'"). 




Figure 5.8 Convolution of the frequency response of a rectangular window with an ideal 
filter. (Reprinted from Ref. 9, with permission from John Wiley & Sons, Inc.) 
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5.3.2 Use of Window Functions 

In order to reduce the effects of the Gibbs phenomenon, some researchers have 
proposed the use of tapered windows [11,12]; many others have proposed other 
types of window functions. Only a few of the more popular window functions 
are given below. Note that the number of coefficients generated by the window 
functions given below is 2M + 1 = + 1: 

Bartlett window:^ 



w(n) = 1 



M+l 



-M <n < M 



Hann window: 



1 

w{n) = - 



1 + cos 



2nn 
2M+1 



-M <n < M 



Hamming window: 

w(n) = 0.54 + 0.46 cos 



/ 2itn \ 
\2M+l) 



-M < n < M 



Blackman window: 



win) = 0.42 + 0.5 cos 



I + 0.08 cos I ; 

V2M+1/ V2M+1/ 



-M < n < M 



The frequency responses of the window functions listed above have different 
mainlobe widths Acom and different peak magnitudes of their sidelobes. In the 
plot of HM{e^'") shown in Figure 5.9, it is seen that the difference between the 
two frequencies at which the peak error in 7/m occurs is denoted as Acom- 
When the frequency response of the window functions is convolved with the 
frequency response of the desired lowpass filter, the transition bandwidth of the 
filter is determined by the width of the mainlobe of the window chosen and hence 
is different for filters modified by the different window functions. The relative 
sidelobe level is defined as the difference in decibels between the magni- 
tudes of the mainlobe of the window function chosen and the largest sidelobe. 
It determines the maximum attenuation Ag = — 201ogiQ(5) in the stopband of 
the filter. 

In Figure 5.9 we have also shown the transition bandwidth Aco and the center 

frequency — (cOp + cOc)/2, where cOp and are respectively the cutoff fre- 
quencies of the passband and the stopband. The value of the ripple 8 does not 
depend on the length (2M + 1) of the filter or the cutoff frequency coc of the 



^In many textbooks, the Bartlett window is also called a triangular window, but in MATLAB, the 
Bartlett window is different from the triangular window. 
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H{a>) 




Figure 5.9 Frequency response of an ideal filter and final design. (Reprinted from Ref. 9, 
with permission from John Wiley & Sons, Inc.) 

filter. The width of the mainlobe Acl>m, the transition bandwidth Ao), and the 
relative sidelobe attenuation Asi for the few chosen window functions are listed in 
Table 5.1. The last column lists the minimum attenuation A., — — 201ogjo Ss real- 
ized by the lowpass filters, using the corresponding window functions. It should 
be pointed out that the numbers in Table 5.1 have been obtained by simulating 
the performance of type I FIR filters with w^. — OAn and M = 128 [I], and they 
would change if other types of filters and other values for cd^ and M are chosen. 
From Table 5.1, we see that as Aj increases, with fixed value for M, the transition 
bandwidth Aco also increases. Since we like to have a large value for and a 
small value for Aco, we have to make a tradeoff between them. The choice of the 
window function and the value for M are the only two freedoms that we have for 
controlling the transition bandwidth Am, but the minimum stopband attenuation 
Aj depends only on the window function we choose, and not the value of M. 

Two window functions that provide control over both (hence A J and the 
width of the transition bandwidth Aco are the Dolph-Chebyshev window [6] and 
the Kaiser window functions [7], which have the additional parameters r and fi, 
respectively. The Kaiser window is defined by 



lo IpVl - (n/M)A 
w(n) = — !^ '-■ -M<n<M (5.41) 

hm - - 
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TABLE 5.1 Some Properties of Commonly Used Windows 



Type of Window 


Acom 


Aw 


Asi (dB) 


As (dB) 


Rectangular 


47r/(2M+ 1) 


Q.92nlM 


13 


20.9 


Bartlett 


A7t/{M + 1) 


a 


26.5 


a 


Hann 


8jr/(2M+ 1) 


3.lln/M 


31.5 


43.9 


Hamming 


8;t/(2M + 1) 


3.327T/M 


42.7 


54.5 


Blackman 


127r/(2M+ 1) 


5.567T/M 


58.1 


75.3 



"The frequency response of the Bartlett window decreases monotonically and therefore does not have 
sidelobes. So the transition bandwidth and sidelobe attenuation cannot be found for this window. 



where /q {■} is the modified zero-order Bessel function. It is a power series of 
the form ^ 

■{x/2)' 



Io{x} = 1 + E 



kl 



(5.42) 



k^l 

We compute the values of the Kaiser window function in three steps as follows: 

• The parameter ^ required to achieve the desired attenuation Us = 

— 201ogio((5j) in the stopband is calculated from the following empirical 
formula derived by Kaiser (the ripple in the passband is nearly the same 
as Ss): 

0.1102(a, - 8.7) for a, > 50 

= 0.5842(a, - 21)0-4 ^ o.07886(a;s - 21) for 21 < a, < 50 
[ 0 for as < 21 

(5.43) 

• Next the order of the filter N (=2M) is estimated from another empirical 
formula derived by Kaiser: 

(a, - 8) 

N = — — (5.44) 

2.285 (Actf) ^ ^ 

where Aco = cOg — cOp is the transition bandwidth as shown in Figure 5.9. 

• The third step is to compute Iq{x}. In practice, adding a finite number of 
terms, say, 20 terms of the infinite series, gives a sufficiently accurate value 
for Io{x}. The parameter x in the numerator represents P^l — {n/M)^ in the 
numerator of (5.41), so the value of x takes different values as n changes. 



5.3.3 FIR Filter Design Procedures 

The steps discussed in the design procedure for linear phase FIR filters are sum- 
marized as follows: 



FOURIER SERIES METHOD MODIFIED BY WINDOWS 



269 



1. Depending on the nature of the magnitude response, we choose a value 
for M and use (5.31), (5.34), (5.35), or (5.36) to compute the values of 
the coefficients Clp(«), Capin), CBp(n), or Cbs(«) for —M < n < M. 
Then we choose a window function (Bartlett, Hamming, Hann, Kaiser, 
or other window) and compute its values win) for —M < n < M. In the 
case of Kaiser's window, we find the value of M — N /2 from (5.44), 
whereas he has derived a few other empirical formulas to estimate the 
value of A'^, for designing FIR filters using other window functions.^ Note 
that we have to choose the lowest even integer greater than the value 
calculated from (5.44), since Kaiser's window is used for the design of 
type I filters only. 

2. Then we multiply the coefficients c{n) and w{n) to get the values of 
hyo(n). The filter with these finite numbers of coefficients has a frequency 
response given by H^iej"') = /Zu,(-M)e^"^ + hy,{-M + i)e;(-A^+i)<» + 
• • • + h^{\)ei'" + hUO) + hUl)e-j'" + •••+ h^iM)e-j^''. 

3. The next step is to multiply H^{e''") by e~j'^'", which is equivalent to 
delaying the coefficients by M samples to get h{n) [i.e., h^jin — M) = 
h{n)\. By delaying the product of c{n) and win) by M samples, we have 
obtained a causal filter of finite length {N + 1) with coefficients h{n) for 
Q<n<N. 

The procedure becomes a little better understood by considering Figure 5.7 
(where a rectangular window has been used). Since H^{e^'^) is a real function 
of CO, its magnitude does not change when we multiply it by e"-'^'". Now we 
have an FIR filter H(z~^) — Z],^=o ''(")^~"' which is causal and is of length 
(N + 1) and has the same magnitude as |7/u,(e^")|. Its phase response is —Mco 
with an additional angle of n radians when Hy,{e^'^) attains a negative real 
value. Its group delay is a constant equal to M samples. This completes the 
general procedure for designing an FIR filter that approximates the ideal magni- 
tude response of a lowpass FIR filter; similar procedures are used for designing 
highpass, bandpass, and bandstop filters. Let us illustrate this procedure by two 
simple examples. 

'The formulas given by Kaiser may not give a robust estimate of the order for all cases of FIR filters. 
A more reliable estimate is given by an empirical formula [10] shown below, and that formula is 
used in the MATLAB function remezord: 





(ftjj - a>p)' 
lit 


2 




2jt 





where Dao(Sp, 3j) (when Sp > 3J = [ai(logio Spf + a2(logio Sp) + 03] logig - [a4(logio Spf+ 
asOogioSp) -l-ae], and F(5p, 5,) = fci + ^2 [logio^p - logio^j], with ai = 0.005309, 02 = 
0.07114, 03 = -0.4761, 04 = 0.00266, 05 = 0.5941, ag = 0.4278, bi = 11.01217, fcj = 0.51244. 
When Sp < S^, they are interchanged in the expression for D^oiSp, Ss) above. 
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Example 5.6 



Design a bandpass filter that approximates the ideal magnitude response given in 
Figure 5.5(c), in which cod = 0.6n and Wd = 0.2jt. Let us select a Hamming 
window of length = 11 and plot the magnitude response of the filter. 

The coefficients CBp(n) of the Fourier series for the magnitude response given 
are computed from formula (5.35) given below: 



CBP(«) = 



{a)c2 -Mcl ) 



n 



sin(a>c2n) sin(a)cin) 



n = 0 
\n\ > 0 



But since the Hamming window function has a length of 11, we need to compute 
the coefficients CBp(n) also, from n = — 5 to n = 5 only. So also we calculate 
the 1 1 coefficients of the Hamming window, using the formula 



WHin) = 0.54 + 0.46 cos 



Inn 



-5 < « < 5 



Their products h,j,(n) = CQp{n)wu{n) are computed next. The 11 coefficients 
CBp(n), WHin) and h-ujin) for — 5 < n < 5 are listed below. Next the coefficients 
hyj{n) are delayed by five samples to get the coefficients of the FIR filter function 
[i.e., h{n) — hyjin — 5)], and these are also listed for 0 < n < 10 below. The 
plot of the four sequences and the magnitude response of the FIR are shown in 
Figures 5.10 and 5.11, respectively. 

CBp(n) = 0.00 0.0289 -0.1633 -0.2449 0.1156 0.400 0.1156 

-0.2449 -0.1633 0.0289 0.000 
WHin) = Om 0.1679 0.0379 0.6821 0.9121 1.0 0.9121 

0.6821 0.0379 0.1679 0.0800 
hujin) = Om 0.0049 -0.0650 -0.1671 0.1055 0.4000 0.1055 

-0.1671 -0.0650 0.0049 0.000 



h(n) 


0.0000 


0.0049 


-0.0650 


-0.1671 


0.1055 0.4000 




0.1055 


-0.1671 


-0.0650 


0.0049 


0.0000 



Example 5.7 

Design a lowpass FIR filter of length 11, with a cutoff frequency cOc = 0.3n. 
Using a Hamming window, find the value of the samples h(3) and h{9) of the 
FIR filter given by //(z"') = Ei=o^(«)z""- 

Since the length of the FIR filter is given as 11, its order is N = 10. The 
coefficients («) have to be known for — 5 < n < 5 and delayed by five samples. 
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Founer series coefficients of the BP filter 
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Figure 5.10 Coefficients of the filter obtained during the design procedure. 
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Figure 5.12 (a) Ideal magnitude response of a multilevel FIR filter; (b) Magnitude 
response of a lowpass filter with a spline function of zero order. 

Since only h(3) and /z(9) are asked for, by looking at Figure 5.10, we notice that 
these samples are the same as /!„,(— 2) and /!u,(4) because when they are shifted 
by five samples, they become h(3) and h{9). So we have to calculate only 
clp(— 2), clp(4) and the values w{—2), w{4) of the Hamming window. Then 
= clp(-2)m;(-2) and h^{4) = clp(4)m;(4). 

If the frequency response of an FIR filter has multilevel magnitude levels, it 
is easy to extend the method as illustrated by Figure 5.12a. We design a lowpass 
filter with a cutoff frequency and a maximum magnitude of 0.8, another 
lowpass filter with a cutoff frequency cl)c2, and a maximum magnitude of 0.2 
in the passband; we design a highpass filter with a cutoff frequency coc3 and a 
maximum value of 0.5 and another bandpass filter with cutoff frequencies cdc3 and 
a>c4 and a maximum magnitude of 1 .0. If all of these filters are designed to have 
zero phase or the same phase response, then the sum of the four filters described 
above will approximate the magnitude levels over the different passbands. Each 
of the four filters should be designed to have very low sidelobes so that they 
don't spill over too much into the passbands of the adjacent filter. 

Even when we design an FIR filter having a constant magnitude over one 
passband or one stopband, using the methods described above will produce a 
transition band between the ideal passband and the stopband. Instead of mitigating 
the Gibbs overshoot at points of discontinuity by using tapered windows, we 
can make a modification to the ideal piecewise, constant magnitude response to 
remove the discontinuities. We choose a spline function of order p >0 between 
the passband and the stopband [5]. The spline function of zero order is a straight 
line joining the edge of the passband and the stopband as shown in Figure 5.12b 
The Fourier series coefficients for the lowpass frequency response in this are 
given by 



n = 0 



71 




\n\ > 0 



(5.45) 



where Ato — Ms — tOp and — [(wj + cOp)/2]. 
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A smoother transition is achieved when we choose a higher-order sphne func- 
tion (e.g., p = 2,3,4). In that case, the Fourier series coefficients are given by 



Design procedure using this formula seems easier than the Fourier series method 
using window functions — since we do not have to compute the coefficients of 
window functions and multiply these coefficients by those of the ideal frequency 
response. But it is applicable for the design of lowpass filters only. However, 
extensive simulation of this design procedure shows that as the bandwidth Acw 
is decreased and as p is increased, the magnitude response of the filter exhibits 
ripples in the passband as well as the stopband, and it is not much better than 
the response we can obtain from the windowed FIR filters. 

5.4 DESIGN OF WINDOWED FIR FILTERS USING MATLAB 
5.4.1 Estimation of Filter Order 

In the discussion of the Fourier series method, it was pointed out that we had a 
choice only between the windows (Bartlett, Hamming, Hann, etc.) and the order 
N = 2M of the filter. There is no guideline for choosing the type of window 
or the value for A^; in other words, they are chosen arbitrarily on a trial-and- 
error basis until the specifications are satisfied. But in the case of Kaiser and 
Dolph-Chebyshev windows, we have an empirical formula to estimate the order 
that achieves a desired stopband attenuation a^. However, it was pointed 
out earlier that some authors have derived empirical formulas for estimating the 
order N even when windows like those mentioned above are chosen. We use 
the MATLAB M-file kaiserord (available in the MATLAB Signal Processing 
Toolbox) to estimate the order A' of the filter using the Kaiser window. We will, 
however, use the M-file remezord to estimate the order of the filter using the 
other windows. After the order of the filter has been obtained, the next step in 
the design procedure is to find the values of the unit impulse response h(n) of 
the filter that are the same as the coefficients of the FIR filter transfer function. 
The MATLAB M-file f iri is used for designing filters with piecewise constant 
magnitudes discussed above, and f ir2 is the M-file used for arbitrary magnitude 
specifications. In the following examples, note that N is the order of the FIR filter 
that therefore has -I- 1 coefficients but A^ is the number of coefficients in such 
MATLAB functions such as hamming used for computing the window functions! 

Example 5.8 

If the magnitude response specified in the passband of an FIR filter lies between 
1 + Sp and I — Sp, then the maximum attenuation ap{ in decibels) in the passband 



n = 0 



71 




\n\ > 0 



(5.46) 
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is 20 log 10(1 + 8p) - 20 log 10(1 - 8p) = 201og[(l + Sp)/(l - Sp)]. Solving for 
Sp in this case, we get 

2Q0.05ap _ J 

If the passband magnitude lies between 1 and (1 — Sp), then the maximum atten- 
uation in the passband Up = —20 log(l — Sp), in which case Sp is given by 
(1 — lO"""^"?). If the magnitude in the stopband lies below S,, the minimum 
attenuation in the stopband is given by = — 201og(35), from which we obtain 
8^ = lO"'' ''^"^ These relations are used to find the value of Sp and S^ if the 
attenuations Up and a, in the passband and stopband are specified in decibels. 

In the MATLAB function [N, f points, magpoints,wt] = remezord 
(edgepoints, bandmag, dev, Fs), the input vector edgepoints lists the 
edges of the disjoint bands between 0 and the Nyquist frequency but does not 
include the frequency at « = 0 and the Nyquist frequency, as the default value of 
the Nyquist frequency is 1.0 (and therefore the sampling frequency Fs=2). The 
vector bandmag lists the magnitudes over each of the passbands and stopbands. 
If there is transition band between the passband and stopband, it is considered 
as a "don't care" region. Since the first edge at 0 and the last one at the Nyquist 
frequency are not included in the vector edgepoints, the length of the vector 
edgepoints is two times that of bandmag minus 2. For example, let us choose 
a bandpass filter with a stopband [0 0.1], a transition band [0.1 0.12], a pass- 
band [0.12 0.3], a transition band [0.3 0.32], and a stopband [0.32 1.0]. 
The input vector edgepoints and the output vector fpoints are the same, 
when Fs=2, namely, [0.1 0.12 0.3 0.32]. The input vector bandmag is of 
length 3, and the values may be chosen, for example, as [0 1 0] for the band- 
pass filter. The vector dev lists the values for the maximum deviations Sp and 
8s in the passbands and stopbands, calculated from the specifications for ap and 
as as explained above. The output vector fpoints is the same as edgepoints 
when Fs has the default value of 2; if the edgepoints and the sampling fre- 
quency Fs are actual frequencies in hertz, then the output vector fpoints gives 
their values normalized by the actual Nyquist frequency Fs/2. But it must be 
pointed out that the output vector magpoints lists the magnitudes at both ends 
of the passbands and stopbands. In the above example, the vector magpoints 
is [0 0 1 1 0 0]. The output of this function is used as the input data to 
f iri and (also the function remez, discussed later) to obtain the unit impulse 
response coefficients of the FIR filter. 

Let us consider a lowpass filter with a passband over [0 0.3] and a magnitude 
1.0 and a stopband over [0.4 1.0] with a magnitude 0.0. In this case, there is 
transition band between 0.3 and 0.4 over which the magnitude is not specified, 
and therefore it is a "don't care" region. The vector edgepoints is [0.3 0.4], 
and the vector bandmag is [1.0 0.0]. For the previous example of a bandpass 
filter, we have already mentioned that edgepoints is [0.1 0.12 0.3 0.32] 
and the vector bandmag is [0 1 0] . Let us select Sp = 8s = 0.01 for both 



DESIGN OF WINDOWED FIR FILTERS USING MATLAB 275 

filters, namely, a log magnitude of Up = — 201og(l — Sp) = 0.087 dB for the 
ripple in the passband and a gain of —40 dB in the stopband. 

The function remezord for estimating the order of the lowpass filter is as 
follows: 

[N, f points, magpoints, wt] = remezord ( [0 . 3 0.4], [1.0 0.0], 
[0 . 01 0 . 01] , 2) 

and it yields a value N = 39, with the same vector fpoints as bandmag and the 
vector wt = [1 . 0 i . O] . If we choose a sampling frequency of 2000 Hz, we use 
remezord( [0.3 0.4], [1.0 0.0], [0.01 0.01], 2 0 0 0 ), and the output 
would be = 39, fpoints= [0 . 3 0.4], magpoints=[i 1 0 o]andthevec- 
tor wt = [1.0 1.0]. The elements in the vector wt will be unequal if dp ^ Ss 
[i.e., wt = [{Ss/Sp) 1]]. These output values are used as input in firi (or 
remez) for the design of the lowpass filter. 

The function for estimating the order of the bandpass filter is 

[N, fpoints, magpoints, wt] =remezord ( [0 . 1 0.12 0.3 0.32], 
[0.0 1.0 0.0], [0.01 0.01 0.01], 2). 

which gives A' = 195, with the same vector fpoints as the input vector edge- 
points, magpoints= [0 0 1 1 0 0] , and wt = [111] as in the input. 

The IvlATLAB function kaiserord given below is used to estimate the order 
N of the FIR filter using the Kaiser window. The input parameters for this 
function are the same as for remezord, but the outputs are the approximate order 
N of the Kaiser window required to meet the input specifications, the normaUzed 
frequencies at the bandedges, the parameter beta, and the f iltertype: 

[N, Wc, Beta, ftype] =kaiserord (edgepoints, bandmag, dev, Fs) 

For the lowpass filter specified above, we use 

[N, Wc, Beta, ftype] =kaiserord ( [0 . 3 0.4], [1.0 0.0], 
[0 . 01 0 . 01] , 2) 

and we get N=45, Wc=0.35, Beta=3.3953. 

For the bandpass filter, with the same input parameters as those used in reme - 
zord, we get the output parameters as N=224 , wc= [o . ii o . 31] , Beta=3 .3953, 
and f type=DC- 0. When f type=DC- 0, this means that the first band is a stopband 
and when it is dc-i, it indicates that the first band is a passband. 

5.4.2 Design of the FIR Filter 

After we have found the order of the filter and any other parameters as the output 
of the functions remezord and kaiserord, we use the function f iri, which 
takes various forms as described below: 
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b=f in (N,Wc) 

b=f in (N, Wc, ' f type' ) 

b=f irl (N, Wc, ' f type ' , window) 

These forms give the + 1 samples of the unit impulse response of the lin- 
ear phase FIR filter or the coefficients of its transfer function, wc is the cutoff 
frequency of the lowpass filter, and f type is omitted; it is the cutoff of the high- 
pass filter when 'ftype' is typed as 'high'. But Wc is a two-element vector 
Wc= [wi W2] , which lists the two cutoff frequencies, 0)^ and 0)1^^2 i<^c2 > (^ci), 
of the bandpass filter. (Use help fin to get details when there are multiple 
passbands.) The term 'ftype' need not be typed. When 'ftype' is typed as 
' stop' , the vector wc represents the cutoff frequencies of the stopband filter. 

If the filter is a lowpass, it becomes a type I filter when N as obtained from 
remezord is even and it is type II filter when A'^ is odd. Note that the frequency 
response of type II filters has a zero magnitude at the Nyquist frequency, that is, 
their transfer function has a zero at z = — 1 and therefore is a polynomial of odd 
order. The highpass and bandstop filters that do not have a zero magnitude at the 
Nyquist frequency cannot be realized as type II filters. When designing a highpass 
or bandstop filter, must be an even integer, and the function f irl automatically 
increases the value of by 1 to make it an even number if the output from 
remezord is an odd integer. Since the program assumes real values for the 
magnitude and zero value for the phase, we do not get types III and IV filters 
from this type of frequency specification. The window by default is the Hamming 
window in f irl, but we can choose the rectangular (boxcar), Bartlett, triangular, 
Hamming, Hanning, Kaiser, and Dolph-Chebyshev (chebwin) windows in the 
function f irl. After getting the coefficients of the FIR filter, we can find the 
magnitude (phase and group delay also) of the filter to verify that it meets the 
specifications; otherwise we may have to increase the value of N, or change the 
values in the vector dev. 

Example 5.9 

Now that we have obtained all the input data needed to design a LP filter with 

A^ = 39 and = 0.3 and a BP filter with N = 195 and = [0.12 0.3], we 
design the FIR filters with the Hamming window and the Kaiser window. So we 
have four cases, discussed below. 

The M-files for designing the four filters are given below, and the resulting 
magnitude responses are shown in Figures 5.13-5.17. 

It must be noted from Figure 5.9 that the magnitude of the filter designed by 
the Fourier series method is 0.5 at coc, whatever the window function used to 
minimize the Gibbs overshoot. The order N = 39 for the lowpass filter, obtained 
from the function remezord, is only an estimate that is very conservative because 
it results in the magnitude response of the filter that does not meet the passband 
error Sp = 0.01 specified and used in that function. So we have to change the 
value for the cutoff frequency coc and the order A^ of the filter by trial and error 
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FIR LP filter response with N = 85 and Hamming window 




0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 
Normalized frequency 

Figure 5.13 Magnitude response of a FIR lowpass filter using Hamming window. 



Magnified plot of the LP filter response 



^ 0.98 




0.1 0.15 0.2 0.25 
Normalized frequency 

Figure 5.14 Magnified frequency response of a FIR lowpass filter in the passband. 



until the specifications are met. For the lowpass FIR filter, we have had to choose 
u>c — 0.35 and = 65 so that at the frequency w — 0.3, the error 5p < 0.01 and 
at a; = 0.4, the error S., < 0.01 (equal to 40 dB). The magnitude response of this 
final design is shown in Figures 5.13 and 5.14. Similar changes in the design of 
the other filters designed by the Fourier series method are necessary. 
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0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 
Normalized frequency W/ji 

Figure 5.15 Magnitude response of a FIR bandpass filter using Hamming window. 




%Case l:Design of the LP filter with N=39 and Hamming window 
bl = f irl (39, 0.3); 
[hi, w] =f reqz (bl, 1, 256); 
Hldb=20*logl0 (abs (h) ) ; 
plot(w/pi, Hldb) ;grid 
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Magnitude of BP filter N = 224 with Kaiser window 



m -40 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 
Normalized frequency W/jr 



Figure 5.17 Magnitude response of a FIR bandpass filter using Kaiser window. 



title (' Magnitude response of FIR LP filter with N=39 and 

Hamming window' ) ; 
ylabel (' Magnitude in dB' ) 
xlabel (' Normalized frequency') 

%Case 2:Design of the BP filter with N=195 and Haming window 
b2=firl(195, [0.12 0.31]); 
[h2,w] =freqz (b2, 1, 256); 
figure 

H2db=20*logl0 (abs (h) ) ; 

title ('FIR BP filter with N=195 and Hamming window') 
ylabel (' Magnitude in dB' ) 
xlabel (' Normalized frequency') 

%Case 3:Design of the LP Filter using the Kaiser window: 
%The length of Kaiser window must be one higher than the 
% order (N=45) of the FIR filter 
%obtained from the function Kaiserord 
b3 = firl(45, 0.35, k;aiser(46, 3.3953)); 
[h3 , w] =freqz (b3 , 1, 256) ; 
H3db=20*logl0 (abs (h3) ) ; 
plot (w/pi,H3db) ; 

title (' Magnitude of LP with N=45 and Kaiser window') 
ylabel (' Magnitude in dB' ) 
xlabel (' Normalized frequency'). 
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%Case 4:Design of the BP Filter using the Kaiser window 
b4=firl(224, [0.11 0.31], kaiser(225, 3.3953)); 
[h4,w] =freqz (b4, 1, 256); 
H4=abs (h4) ; 
H4db=20*loglO (H4) ; 
figure 

plot (w/pi , H4db) ; grid 

title (' Magnitude of BP filter N = 224 with Kaiser window') 
ylabel (' Magnitude in dB' ) ; 
xlabel (' Normalized frequency ') 



5.5 EQUIRIPPLE LINEAR PHASE FIR FILTERS 

The frequency response in the passband of FIR fihers designed by using the mod- 
ified Fourier series method as described above has a monotonically decreasing 
response and a maximum error from the desired ideal response in the passband, at 
the cutoff frequency coc. Now we discuss another important method that "spreads 
out" the error over the passband in an equiripple fashion, such that the maximum 
error is the same at several points and can be made very small. This method min- 
imizes the maximum error in the passband and is called as the minimax design 
or the equiripple design. An example of the equiripple or Chebyshev response 
of a lowpass filter is shown in Figure 5.18. 

Magnitude response of an equiripple FIR filter 

1.4 
1.2 
1 

% 0.8 
c 

I 0.6 
0.4 
0.2 
0 

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 
Normalized frequency 

Figure 5.18 Magnitude response of an equiripple lowpass filter. 
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For types 1-4 FIR filters, the frequency response were shown in (5.22) to be 
of the following form: 



N 



N/2 



'N 

n 

2 



cos (new) 



-MN/2)a>] 



(N+l)/2 

2 E > 

n=l 



N + 1 



for type I (5.47) 



1 



cos I \ n — — ICO 



H(e~-''^) = g-jKiVw-TT)/!] 



N/2 
n=l 



A' 



— n 



sin(nco) 



for type II (5.48) 



for type IH (5.49) 



(N+\)/2 r 



E 

n=l 



N+ 1 



sm 1 \ n- -]co 



for type IV (5.50) 



In general, Equations (5.47)-(5.50) are of the form H{e-'") = e 



-j(Na>/2).jfi 



Hnio)), where"^ is either 0 or 7r/2 depending on the type of filter, and Hr{ci)) 
is a real function of co, which can have positive or negative values. It is easy to 
see that Hr (co) for type I filters can be reduced to the form (2M = ) 



M 



Hr(co) = y^ a[k] cos{ka>) 



where 

a[0] = h[Ml a[k] = 2h[M - k], l<k<M 
Consider Hr{(i>) for the type II filter shown in (5.48) and given below: 

(W+l)/2 



(5.51) 



(5.52) 



Hr{w)=2 ^ h 



n=\ 



N +\ 



COS I \ n — - \ CO 



This can be reduced to the form 

(2M+l)/2 



HRico)^ I] b[k]cos\^l^k--jcoj 



(5.53) 



''This is not the same parameter j8 that is used in Kaiser's window. 
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where b[k] = 2h{[(2M + l)/2] -k}, l<k< [(2M + l)/2]. This can be fur- 
ther reduced to the form 

(2M-l)/2 

= COS (I) J2 b[k]cos(kco) (5.54) 

where 

^[1] = ^ (^[1] + 2m) 

1 ,~ ~ , 2M - 1 

b[k] = - {b[k] + bik-l)), 2<k< (5.55) 

Let us consider the function Hr{co) for a type III filter. Equation (5.49) can be 
reduced to the form 

(2M+l)/2 

Hr((o)= J2 c[k]smik(o) (5.56) 
k=l 

where c[k] = 2h[M — k], I < k < M. This can be reduced to the form 

M-l 

Hr{(o) = sin(ft)) ^ cos (fect)) (5.57) 

k=0 

where 

c[l] = {m - 

cW = i (?tA: - 1] - StA:]) , 2<k<M-l (5.58) 
c[M] = i?tM - 1] 

Finally we express Hr (&>) for a type IV filter as 

(2M + l)/2 

Hr{co)= ^ d{k]sm{{k-\)(o) (5.59) 

where d[k] = 2/j{[(2M + l)/2] - A;}, 1 < A; < {2M + l)/2. Equation (5.59) can 
be reduced to the form 

(2M-l)/2 

HRia)) = ^m{^ d[k]cos{k(o) (5.60) 
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where 



d[l] = {d[0] 
d[k] 
2M+ 1 



d[l]) 



= d 



\ {d[k - 1] - d[k]) . 
2M -I' 



Note that we can express the coefficients a[.], b[.], c[.], d[.] in terms of a[.], 
b[.], c[.], d[.] since they are hnearly related. We express Equations (5.51), (5.54), 
(5.57), and (5.60) in a common form, (5.61), in order to develop a common 
algorithm that obtains a minimax approximation for all four types of filters 



Hr(co) = Q{co)P{co) 



where 



1 for type I 

cos (^) for type II 

sin(ft;) for type III 

sin (f ) for type IV 



and 



where 



P(o)) = y^^ajk] cos(ka>) 



a[k] = 



k=0 

a[k] for type I 

b[k] for type 11 

c[k] for type 111 

d[k] for type IV 



and 



K = 



M 

2M ■ 



2 

M - I 
2M-1 



for type I 

for type II 
for type III 

for type IV 



(5.61) 



(5.62) 



(5.63) 



(5.64) 



(5.65) 



We define a weighted error function 



= WienQico) 



P{co) 



(5.66) 
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Using the notations Wiej"')Qico) = W(e-"") and Haiej'")/Qiej'") = H^iej'"), 
this equation is now rewritten in another form as 

Jico) = Wien [P{co) - HAen] (5.67) 

In these equations, HdieJ'") is the desired frequency response normally specified 
over subintervals of 0 < « < ;t and W{e'") is a weighting function chosen by the 
designer to emphasize relative magnitude of the error over different subintervals. 
In usual filter design applications, the desired magnitude is given as 

M (J(o^ _ J 1 ± in the passband(s) 

^d^e ; - I Q _^ jjjg stopband(s) ^ ^ ^ 



The weighting function W(ej'^) can be chosen as 



1 in the passband(s) 



— in the stopband(s) 



or as 



in the passband(s) 
1 in the stopband(s) 



The coefficients a[k] in (5.67) are the unknown variables that have to be found 
such that the maximum absolute value of the error \J(co)\ over the subintervals 
of 0 < tw < TT is minimized. It has been shown [13] that when this minimum 
value is achieved, the frequency response exhibits an equiripple behavior: 

r m, """""re, \W {6^1 Pico) - Hd(en]\ (5.69) 
over {a [A:]} over {5} I ^ L ^ ■'il ^ ^ 

where {5} is used to denote the union of the disjoint fi-equency bands in 0 < 

CD <n. 

Once these coefficients are determined, the coefficients h{n) can be obtained 

from the inverse relationships between a[k] and a[k], h\k], c\k], and d[k] depend- 
ing on the type of filter and then using the relationship between h[n] and these 
coefficients. 

Parks and McClellan [2] were the original authors who solved the preceding 
problem of minimizing the maximum absolute value of the error function Jico), 
using the theory of Chebyshev approximation, and developed an algorithm to 
implement it by using a scheme called the Remez exchange algorithm. They also 
published a computer program (in FORTRAN) for designing equiripple, linear 
phase nR filters. Although major improvements have been made by others to this 
algorithm and to the software [13], it is still referred to as the Parks -McClellan 
algorithm or the Remez exchange algorithm. We will work out a few examples of 
designing such filters using the MATLAB function remez in the following section. 
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5.6 DESIGN OF EQUIRIPPLE FIR FILTERS USING MATLAB 

The first step is to estimate the order of the FIR filter, using the function reme- 
zord which was explained earlier. The next step is to find the coefficients of the 
FIR filter using the function remez, which has several options: 

b=remez (N, fpoints, magpoints) 

b=remez (N, fpoints, magpoints, wt) 

b=remez (N, fpoints, magpoints, 'ftype') 

b=remez (N, fpoints, magpoints, wt, 'ftype') 

The vector fpoints lists the edges of the passbands and stopbands, starting 
from 0) = 0 and ending with o) = I (which is the normalized Nyquist frequency). 
In contrast to the function remezord, this vector fpoints includes 0 and 1.0 
as the first and last entries. The edges between the passbands and the adjacent 
stopband must have a separation of at least 0.1; otherwise the program automat- 
ically creates a transition band of 0.1 between them, and these transition bands 
are considered as "don't care" regions. The vector magpoints lists the mag- 
nitudes in the frequency response at each edge of the passband and stopband. 
The weighting function can be prescribed for each frequency band as explained 
above. The function remez chooses type I filters for even-order N and type II 
filters for odd order as the default choice. The flags 'hilbert' and 'differ- 
entiator' are used for the option ftype for designing the Hilbert transformer 
and the differentiator, respectively. The other input variables are the same as 
the outputs obtained from remezord, and hence we can use the two functions 
remezord and remez together in one M-file to design an equiripple FIR filter 
with linear phase as listed and described below. 

5.6.1 Use of MATLAB Program to Design Equiripple FIR Filters 
Example 5.10 

%Program to obtain the unit impulse response coefficients 
% of an equiripple, FIR filter with a linear phase 
edgepoints= input ('Type in the edge frequencies of 

each band = ' ) ; 
%Type in normalized edge frequencies between 0 and 1, 
% excluding 0 and 1, when Fs=2 

%or actual frequencies in Hz and choose FT also in Hz 
Fs= input (' Sampling frequency in Hz =') 

%The bandmag is the magnitude in each band from 0 to 1 
bandmag =input('Type in the magnitude values for each 

passband and stopband ='); 
% There must be one value in dev and in wt for each band 
dev=input (' Desired ripple in each band ='); 
wt= input (' Type in values for the relative weights in each 
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band= ' ) ; 

[N, fpoints, magpoints, wt] =remezord (edgepoints , bandmag, 

dev, Fs) ; 

dispC Order of the FIR filter is ' ) ; disp (N) ; 
b=remez (N, fpoints, magpoints, wt) ; 
[h, w]=freqz(b, 1, 256); 
H=abs (h) ; 
Hdb=20*loglO (H) ; 
plot (w/pi , Hdb) ; grid 

title (' Magnitude response of the equiripple, linear phase 

FIR filter' ) 
ylabel (' Magnitude in dB' ) 
xlabel (' Normalized frequency'} 

This program can be used to design lowpass, highpass, bandpass, and bandstop 
filters. If tlie filter does not meet the given specification, one should increase 
the order of the filter by 1, 2, or 3 until the specifications in the passbands and 
stopbands are met. But when the cutoff frequencies are very close to 0 or 1, and 
when we are designing highpass and stopband filters, the value of estimated 
by remezord may not be acceptable, and we may have to choose it arbitrarily 
to meet the given specifications. If one is interested in getting an enlarged view 
of the magnitude response over a frequency range such as the passband, then 
the following Unes may be added to the program listed above. In the function 
axis, choose wci = o and wc2 = passband edge frequency for the lowpass filter 
and wci and wc2 as the lower and upper cutoff frequencies of the passband of a 
bandpass filter or the stopband of a bandstop filter: 

%Add the following lines to get an enlarged view of the 

% magnitude response 

figure 

wci = input (' Type in the lower cutoff frequency =') 
wc2 = input (' Type in the upper cutoff frequency=') 
plot (w/pi, Hdb) ;Grid 
axis ( [wci wc2 -0.5 0.5]); 

title (' Enlarged plot of the magnitude response') 
ylabel (' Magnitude in dB') 
xlabel (' Normalized frequency') 

Example 5.11 

Let us work a few examples using the program displayed above for designing 
lowpass and bandpass equiripple filters with the same specifications as the earlier 
ones. We type in the following input data for designing an equiripple lowpass 
filter: 

edgepoints : [0 . 3 0.4] 
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bandmag : [1 0] 

dev : [0 . 01 0 . 01] 

wt : [1 1] 



The frequency response of the lowpass filter is shown in Figure 5.19, and a 
magnified view of the response in the passband is shown in Figure 5.20. It is 
seen that the deviation in the passband is within 0.087 dB, which is equivalent 
to 8p = 0.01 in the passband, but the magnitude in the stopband is not equal to 
or less than —40 dB, corresponding to — 0.01. 

Therefore we increase the value of from 39 to 41 and show the resulting 
filter response displayed in Figure 5.21, which does meet the stopband magnitude 
required. 

Next we design an equiripple bandpass filter meeting the same specifications 
as those that used the Hamming window and the Kaiser window. The input 
parameter values are the following: 



edgepoints :[0.1 0.12 0.3 0.32] 

bandmag : [0 1 0] 

dev : [0 . 01 0.01 0.01] 

wt : [1 1 1] 



The magnitude response of the equiripple filter is shown in Figure 5.22. 
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Figure 5.19 Magnitude response of an equiripple FIR lowpass filter with A' = 39. 
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Figure 5.20 Magnified plot of the passband response of an equiripple FIR lowpass filter. 
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Figure 5.21 Magnitude response of an equiripple FIR lowpass filter with = 41. 



When we design an equiripple bandstop filter with the same vector edgepoints 
as in the preceding bandstop filter, we get a response that does not meet the 
desired specifications even after the order of the FIR filter is increased from 195 
to 205. Also, the design of a highpass filter using the Remez algorithm is not 
always successful. In Section 5.7, an alternative approach to solve such problems 
is suggested. 
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It should also be remembered that the Remez algorithm is restricted to filters 
of order greater than 3. It is interesting to note that the bandpass filter of order 
195, using the Fourier series and the Hamming window achieves a higher stop- 
band attenuation than does a bandpass filter of the same length, using the Remez 
algorithm. 



5.7 FREQUENCY SAMPLING METHOD 

In the methods considered above for the design of linear phase FIR filters, the 
magnitude response was specified as constant over disjoint bands, and the transi- 
tion bands were "don't care" regions. In this section, we discuss briefly the MAT- 
LAB function f ir2 that designs a linear phase filter with multistage magnitudes 

b=fir2(N, F, M) 

b=f ir2 (N, F, M, window) 

b=f ir2 (N, F, M, window, npt) 

and so on. As input parameters for this function, n is the order of the filter and 
F is the vector of frequencies between 0 and 1 at which the magnitudes are 
specified. In the vector f, we include the end frequencies 0 and 1 and list the 
magnitudes at these frequencies in the vector m, so the lengths of f and M are the 
same. The argument npt is the number of gridpoints equally spaced between 0 
and 1; the default value is 512. Frequencies at the edge of adjacent bands can be 
included and will appear twice in the vector f indicating a jump discontinuity. 
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The output of this function is the A'^ + 1 coefficients of the unit impulse response 
of the FIR fiher with hnear phase. 

Example 5. 12 

%Program to design an FIR fiter using fir2 
F =[0 0.25 0.25 0.5 0.65 0.75 0.9 1.0]; 
M = [0 1 0.5 0.5 0 0 0.3 0.3]; 
b=fir2 (128, F, M) ; 
[h, w] =f reqz (b, 1, 256); 
H=abs (h) ; 

plot (w/pi , H) ;Grid; 

title ('' Multistage Magnitude Response of an FIR linear 

phase filter' ) 
ylabel ( ' Magnitude ' ) 
xlabel (' Normalized frequency') 
%end 

The magnitude response of this filter is shown in Figure 5.23. 

The function f ir2 utilizes the relationship between the DFT and IDFT of an 
FIR filter. Note that we prescribed the magnitude of the filter response over the 
frequency range 0-1.0 and the function assumes that the samples of the DFT 
are symmetric about the Nyquist frequency and extrapolates the samples up to 
the sampling frequency before finding the inverse DFT. We also prescribe zero 
value for the phase, and therefore the function is restricted to types I and II FIR 



Magnitude of a multistage linear phase FIR filter 
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Figure 5.23 IVIagnitude response of a multistage FIR filter. 
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filters only. To design FIR filters with linear phase in general, let us first review 
the following results for the DTFT of a digital filter 



H(e''") = H*{e~J'^) = \H{e^'"}\ e 



-j(Ma)-P) 



U 



where M = (A^ - l)/2 and ^ = 0 for types I and II filters and M = (N - l)/2 
and j6 = ±(;r/2) for types III and IV filters. 

Next, be aware that in the notation commonly used for the DFT-IDFT pair, N 
is the length of the FIR filter or the number of unit impulse response coefficients 
h(n) and is also equal to the number of DFT samples H(k) as shown in the 
following relationships: 



N-l 



n=0 



N-l 



h{n) = ^Y. (fc)e^'^"'/^^"* 



(5.70) 

for yt = 0, 1,2, (A^ - 1) 
forn = 0...(Ar- 1) (5.71) 



*:=0 



For an FIR filters with linear phase, h(n) — ±h(N — I — n), n — 
0, 1, 2, . . . , (A^ — 1), where the plus sign is used for types I and II linear phase 
filters and the minus sign is used for types III and IV Unear phase filters. 

The DFT H{k) must satisfy the following conditions: 



H{k) = 



|H(0) forfe = 0 

\H{N-k) forfe=l,2, , 

-mm 



(N-l) 



N - 1 



2n(N -k) 
N 



for /t = 0,1,..., 

and types I and II filters 
N - 1 

for k 
■ I . 



2 

(N-l) 
and types I and II filters 



(4) 



N- 1 



27rA; 



foTk = 0, I,.. 
A^- I 



N -l\ /2n(N-k) 



N 



and types III and IV filters 
lor k = 



+l,...,(Af- 1) and 
types III and IV filters 
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These relationships provide us with a general method for finding the unit 
sample response of an FIR filter with linear phase, from the values of the 
DFT samples that are the values of |//(e'™)| e^"^*^'"^^' at the discrete fre- 
quencies a>k = {2Ti/N)k. Therefore we can prescribe both magnitude and phase 
over the entire frequency range, including the transition bands of the filter. The 
method followed to find the unit sample response coefficients h{n) is completely 
numerical, and we know that the efficient FFT techniques are used to compute 
the DFT and IDFT samples. We have already used the MATLAB functions f f t 
and if ft that compute the DFT and IDFT, respectively, in Chapter 3, and the 
function f ir2 simply implements IDFT of H{k) specified by the input vectors 
F and M in the function fir 2. 



5.8 SUMMARY 

In this chapter, we discussed the design theory of FIR filters with linear phase 
and a magnitude response that approximate the magnitudes of ideal LP, HP, BP, 
and BS filters as well as some filters that have magnitude specifications that are 
smooth but not necessarily piecewise constant. We also described a few very 
efficient and well-known MATLAB functions that obtain very good results in 
designing these filters. But there are cases when these functions (and a few others 
not included in this chapter) may not work satisfactorily. Students are encouraged 
to work extensively these MATLAB functions with a variety of specifications and 
input arguments and build their experience and insight about the relative mer- 
its and advantages of the various methods and the MATLAB functions. It was 
pointed out that the function remez does not work very efficiently in designing 
highpass and bandstop filters. We suggest below an alternative approach to solve 
this problem. However, the three transformations given below [1] are more gen- 
eral and useful in transforming the magnitude response of a type I filter into that 
of a wide variety of other magnitude response characteristics. 

Consider a type I filter H{z) = T.l%h{n)z~'' , h(2M - n) = h{n) that has 
a passband frequency o)p and stopband frequency cOs. Its zero phase frequency 
response is Hr(co) = h(M) + Y^n=\ 2h(M — n) cos(nfti). We can obtain three 
new classes of type I filters that have the following transfer functions: 



G{z) = 



z-^ - H{z) 



transformation A 
) transformation B 

H{—z) transformation C 



The corresponding frequency response of these filters is given by 



G{(o) = 



1 — H{m) transformation A 

H(n - co) transformation B 

\ — H{n — CO) transformation C 
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G(oj) = l-H(jr-a)) 



7T — COt;. 71 — OJ^ 



(d) 



Figure 5.24 Transformation of a lowpass filter response to other types of filter responses. 



The responses of these filters are plotted in Figure 5.24. We notice that trans- 
formation A transforms a type I, lowpass filter with a passband (cutoff) frequency 
Wp and a stopband frequency Ws, into a highpass filter with the cutoff frequency 
of cOs and a stopband frequency cOp, whereas transformation B transforms the 
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lowpass filter response into a highpass filter with a cutoff frequency {n — cOp) 
and a stopband frequency (n — tOs). 

To design an equiripple liighpass FIR filter, with passband and stopband cutoff 
frequencies cOp and ftJj, respectively, we first design a lowpass type I equirip- 
ple FIR filter with a passband frequency cOp = n — cOp and a stopband frequency 
Ms = 71 — Ms- Let its transfer function be H(z) = h(n)zr" ■ Then, using the 

transformation G(z) — (— z), we get the transfer function of the high- 
pass filter as G(z) = J2l=o [(-i)^^"h(n)] z"". Transformation C transforms the 
type I lowpass filter into another lowpass filter with a cutoff frequency (n — cos) 
and a stopband frequency (jt — tOp). These transformations provide us with addi- 
tional tools to design filters in the event that any one method fails to give the 
right results. 



PROBLEMS 

5.1 Derive the function for the frequency response in the form e-'^{HR(co)} 
for the FIR filters H(z~^) given below. Identify the type of filters also: 

Hi{z~^) = 1 + 0.6z~^ + 0.2z~^ + 0.4z~^ + 0.2z~^ + 0.6z'^ + 
H2(z-^) = 1.2 + O.lz-i + 0.9Z-2 + - - 

//3(Z-1) = 1 + + _ ^-3 _ ^-4 _ ^-5 
//4(Z-1) = l+Z-3+^-6 

^5(^-1) = 0.4Z-1 - 0.6Z-2 + 1.4z-^ + O.ez'"^ - 0.4Z-5 

5.2 Given that a polynomial Pi (z"' ) = 1 - 2.5z"^ + 5.25z-2 - 2.5z"^ + z""* 
has a zero at z = 1 + 7\/3, find the other zeros of Pi(z~^). 

5.3 The polynomial ^2(2"') = 1-0 - l.Sz"^ + 2.75z-2 -|- 2.75z"^ - l.Sz""* + 
zr^ has zero at z = 0.25 — 70.433. Find the other zeros of P2iz~^). 

5.4 The polynomial PsCz"') = 1 -l- 3.25z"^ - 3.25z"'* - z"*' has zero at z = 
0.5ej^-^''. Find the other zeros of PsCz"^). 

5.5 Find the polynomial N(z~^) that is the mirror image of the polynomial 

D(z-^)= l+0.2z"' - 0.5z-2 + 0.04z"^ Show that the magnitude of 
H(e^-'") — N(e~'")/D(e^-'") is a constant for all frequencies. 

5.6 Find the polynomial N(z~^) that is the anti-mirror image of the polynomial 
D(z"') = 1 -I- 0.32Z-1 -I- 0.6z"^ - 0.4z"^ -I- Clz""*. Show that the magni- 
tude of H{e~^'") = N{e^^"')/D{e^^'^) is a constant for all frequencies. 
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5.7 The passband of a lowpass FIR filter lies between 1 .04 and 0.96, and its 
stopband lies below 0.0016. Find the value of the passband attenuation ap 
and the stopband attenuation ocg. 

5.8 The passband of a lowpass FIR filter lies between 1.15 and 0.9, and its 
stopband lies below 0.0025. Find the value of the passband attenuation ap 
and the stopband attenuation a^. 

5.9 The passband of a lowpass FIR filter lies between 1 + 8p and 1 — 5^, and 

its stopband lies below 5,. If the passband attenuation is 0.15 dB and the 
stopband attenuation is 45 dB, what are the values of &p and 5,? 

5.10 The passband of a lowpass FIR filter lies between 1 + 5p and \ — 8p , and 
its stopband lies below 5^. If the passband attenuation is 0.85 dB and the 
stopband attenuation is 85 dB, what are the values of 8p and 5^? 

5.11 Design a lowpass FIR filter of length of 15, with coc — Q.6ji, using the 
Fourier series method; truncate it with a Hann window, and delay the 
samples by seven samples to get the transfer function of the causal filter. 

5.12 In designing an FIR BP filter with (Wc2 = O.Stt and cod = O.Itt, using 

the Fourier series method and a rectangular window of length 9, what 
are the values of h(?>) and h(9) in the transfer function of the causal FIR 
filter? 

5.13 In designing a bandpass FIR filter Hiz"^) = X!n=o''(")^"' using the 
Fourier series method and a Bartlett window in order to approximate the 
magnitude response of the filter with a)c2 = 5jt/6 and cod = n/2, what 
are the values of the samples h(3) and hi!)? 

5.14 An FIR bandpass filter has cutoff frequencies at 0.25;r and 0.5;r. Find the 

coefficients h{3) and h{6) of its transfer function H(z~^) — 2Zh=o h(n)z~", 
assuming that it is designed using the Fourier series method and a Black- 
man window. 

5.15 Design an FIR filter of length 9, to get a highpass response, with a>c = 
OAn, using a Hamming window. 

5.16 The coefficients of the Fourier series for the frequency response of the 
differentiator are given by 

0 f or n = 0 

c(«) = \ cos(jin) , , 

— - for \n\ > 0 

I n 

Using a Hann window of length 9, find the value of the coefficient h(6) 
of the causal FIR filter that approximates the magnitude response of the 
differentiator. 
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Figure 5.25 Problem 5.18. 



5.17 The coefficients of the Fourier series for the frequency response of a dig- 
ital fiker are c(n) — (0.5)'"'; — oo < ?i < oo. A window function w{n) — 
(—1)", for — 7 < « < 7, is applied to this sequence, and the product is 
delayed by seven samples to get a causal sequence h{n). What is the 
value of the fourth and eighth samples of h(n)l 

5.18 Let xi(n) be a window of length 11 shown in Figure 5.25a and yi(n) = 
xi(n) * xi(n). Plot the function yi{n) and derive its frequency response 
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Figure 5.26 Problem 5.23. 



5.19 Find the convolution sum y2(n) — X2(n) * X2(n) where X2(n) is as shown 
in Figure 5.25b. Plot y2{n) and derive its frequency response (DTFT) 
Y2{en- 

5.20 What is the frequency response of the filter attained by cascading the two 
filters described by Figure 5.27a,b? 

5.21 Plot the spectrum of the product y{n) — x\(n)x2{n) where x\{n) — 10 cos 
{Q.Snn) and X2(«) — cos(0.257rn). 

5.22 If the signal y{n) given in Problem 5.21 is the input to the filter shown 
in Figure 5.27b what is the output signal? 

5.23 Derive the expressions for the Fourier series coefficients (for — oo < 
n < oo) for the DTFT of an LTI DT system as shown in Figure 5.26a,b. 

5.24 Derive the expressions for the Fourier series coefficients for — oo < n < 
oo for the frequency response of the LTI-DT system as shown in 
Figure 5.27a,b, respectively. 
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Figure 5.27 Problem 5.25. 

5.25 Design an HP, FIR filter of length 21 and cdc — QAn, using a Hann 
window. Plot its magnitude response using the MATLAB function 
f ft. 

5.26 Derive the expressions for the Fourier series coefficients (for — oo < 
n < oo) for the DTFT of an LTI-DT system as shown in Figure 5.28a,b. 




Figure 5.28 Problem 5.26. 
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Figure 5.29 Problem 5.27. 



5.27 Find the Fourier series coefficients for the frequency response of the low- 
pass digital filter as shown in Figure 5.29a, in which the Nyquist frequency 
is 500 Hz. 

5.28 Find the Fourier series coefficients for — 5 < n < 5 for the frequency 
response of the lowpass filter shown in Figure 5.29b. 

5.29 Find the coefficients of the unit impulse response for 0 < n < 64, using 
the MATLAB function f ir2 after sampling the frequency response of 
the lowpass filter shown in Figure 5.29b. Compare the result with that 
obtained in Problem 5.28. 

MATLAB Problems 

5.30 Design a lowpass FIR filter of length 21, with cDp — 0.2jt and — 0.57r, 
using the spline function of order p — 2,4 for the transition band. Plot 
the magnitude response of these filters on the same plot. Compare their 
characteristics. 

5.31 Design a lowpass FIR filter of length 41 with cop — 0.3jt and cl>s — 0.57r, 
using the spline function of order p — 2,4 for the transition band. Show 
the magnitude responses of these filters on the same plot. Compare their 
characteristics. 

5.32 Design a lowpass FIR filter of length 41 with cop — 0.4n and — 0.57r, 
using the spline function of order p — 2,4 for the transition band. Give 
the magnitude responses of these filters on the same plot. Compare their 
characteristics. 

5.33 Design a lowpass FIR filter with a passband cutoff frequency cDc — 
0.25jt and a magnitude of 2 dB, a stopband frequency — OAtt, 
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and a magnitude of 0.02. Use a Hamming window and a Hann win- 
dow. Plot the magnitude response to verify that the specifications are 
met. 

5.34 Design a highpass FIR fiher with a passband cutoff frequency Mc — 0.457r 
and a magnitude of 2 dB, a stopband frequency cos = 0.2n, and a magni- 
tude of 0.02. Use a Hamming window and a Kaiser window of length 50. 
Plot the magnitude response to verify that the specifications are met. 

5.35 Design a bandpass FIR filter with the passband between cod — OAjt and 
(Oc2 = 0.6jt with a magnitude of 2.5. Use a Kaiser window. Plot the mag- 
nitude response of the filter. 

5.36 Design a bandpass FIR filter with a passband between fd = 5 kHz and 
fc2 = 6.5 kHz with a magnitude of 2.5, and two stopbands with frequen- 
cies at fsi = 4.5 kHz and fs2 = 7 kHz with a magnitude below 0.025. The 
sampling frequency is 20 kHz. Use a Kaiser window. Plot the magnitude 
response of the filter to verify that the specifications are met. 

5.37 Design a bandstop FIR filter with a stopband between cogi — 0.357r and 
0)^2 = 0.65jt with a magnitude of 0.05, and two passband frequencies at 
(Opi = O.In and C0p2 = O.Sn with magnitudes above 0.95. Use a Kaiser 
window. Plot the magnitude response of the filter. 

5.38 Design an equiripple, lowpass FIR filter with a passband cutoff frequency 
coc = 0.25jt and 8p = 0.05, a stopband frequency cOs = OAn, and a mag- 
nitude below 0.01. Plot the magnitude and verify that the specifications 
are met. 

5.39 Using the results obtained in Problem 5.38 and the frequency transforma- 
tion B described in the main text at the end of this chapter, design an 
equiripple highpass FIR filter. Plot its magnitude response. 

5.40 Using the results for the lowpass FIR filter obtained above, and the fre- 
quency transformation C described at the end of this chapter, design an 
equiripple lowpass FIR filter. Plot its magnitude response. 

5.41 Design an equiripple highpass FIR filter with a passband cut-off frequency 
ft)p = 0.45;r and aup = 0.15 dB, a stopband frequency cOg = 0.2n, and a 
magnitude below 0.025. 

5.42 Design an equiripple bandpass FIR filter with the passband between cod = 
OAn and coc2 = 0.6jt with a magnitude between 1.02 and 0.8. Its stop- 
bands have stopband frequencies at cogi = 0.2jt and (Os2 = O.Sjt with a 
magnitude below 0.005. Plot its magnitude to verify that the specifications 
are met. 
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5.43 Design a bandpass FIR filter with a passband between fd = 6 kHz and 
fc2 = V kHz with ap = 0.2 dB, and two stopbands with stopband fre- 
quencies at /51 — 4 kHz and /v2 = 9 kHz with a, = 35 dB. The samphng 
frequency is 20 kHz. Plot the magnitude response to verify that the spec- 
ifications are met. 
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CHAPTER 6 



Filter Realizations 



6.1 INTRODUCTION 

Once we have obtained the transfer function of an FIR or IIR filter that approxi- 
mates the desired specifications in the frequency domain or the time domain, our 
next step is to investigate as many filter structures as possible, before we decide 
on the optimal or suboptimal algorithm for actual implementation or applica- 
tion. A given transfer function can be realized by several structures or what we 
will call "circuits," and they are all equivalent in the sense that they realize the 
same transfer function under the assumption that the coefficients of the transfer 
function have infinite precision. But in reality, the algorithms for implementing 
the transfer function in hardware depend on the filter structure chosen to realize 
the transfer function. We must also remember that the real hardware has a finite 
number of bits representing the coefficients of the filter as well as the values 
of the input signal at the input. The internal signals at the input of multipliers 
and the signals at the output of the multipliers and adders also are represented 
by a finite number of bits. The effect of rounding or truncation in the addition 
and multiplications of signal values depends on, for example, the type of rep- 
resentation of binary numbers, whether they are in fixed form or floating form, 
or whether they are in sign magnitude or two-complementary form. The effects 
of all these finite values for the number of bits used in hardware implemen- 
tation is commonly called "finite wordlength effects," which we will study in 
Chapter 7. 

In this chapter we develop several methods for realizing the FIR and IIR filters 
by different structures. The analysis or simulation of any transfer function can 
be easily done on a general-purpose computer, personal computer, or worksta- 
tion with a high number of bits for the wordlength. We can also investigate the 
performance of noncausal systems or unstable systems on personal computers. 
Simulation of the performance of an actual microprocessor or a digital signal 
processor (DSP chip) by connecting it to the PC, a development kit that contains 
the microprocessor or the DSP chip, is far preferable to designing and building 
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the digital filter hardware with different finite wordlength and testing its perfor- 
mance. Of course, extensive analysis (simulation) of a given filter function under 
other design criteria such as stability, modularity, pipeline architecture, and noise 
immunity is also carried out on a personal computer or workstation using very 
powerful software that is available today. 

It is true that a real hardware can be programmed to implement a large number 
of algorithms, by storing the data that represent the input signals and coefficients 
of the filter in a memory. But remember that it can implement an algorithm only 
in the time domain, whereas programming it to find the frequency response is 
only a simulation. Three algorithms in the time domain that we have discussed 
in earlier chapters are the recursive algorithm, convolution sum, and the FFT 
algorithm. It is the difference equations describing these algorithms that have to 
be implemented by real digital hardware. 

Consider the general example of an IIR filter function: 



1 + Y!1=\ a{n)z- 



Hiz) = . ^rj; , . (6-1) 



The corresponding linear difference equation that implements it directly is 

N M 

Y^a{k)y{n - k) = Y^b{k)x{n - k); a(0) = I (6.2) 

It can then be rewritten in the form of a recursive algorithm as follows: 

y{n) = -a{l)y{n - 1) + a(2)y(n - 2) + a{3)y{n - 3) + ■ ■ ■ + aiN)yin - N) 
+ b{Q)x(n) + b{l)x{n - 1) + • • • + b{M)y{n - M) (6.3) 

This recursive algorithm can be easily programmed on a general-purpose 
microprocessor, a computer, or a full-function DSP chip. The filter function we 
have obtained can be configured on these devices and convolution between its 
unit impulse response h{n) and the input signal is the actual process used by the 
hardware to produce the output. The convolution sum is given by 

oo 

y{n) = Y^h{k)x(n-k) (6.4) 

In the following pages, it will be shown that this transfer function (6.1) can 

be realized by several structures. We must remember that the algorithms used 
to implement them in the time domain will vary for the different structures. All 
the equivalent structures realize the same transfer function only under infinite 
precision of the coefficients; otherwise their performance depends on the number 
of bits used to represent the coefficients, as well as the input signal and the form 
for representing the binary numbers. The same statement can be made for the 
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realization of an FIR filter function treated in the next section. The purpose of 
realizing different structures and studying the effects of quantization is to find the 
best possible structure that has the minimum quantization effect on the output of 
the system. 



6.2 FIR FILTER REALIZATIONS 



Example 6. 1: Direct Form 



Given the transfer function of an FIR filter as H{z) — ^'^=Qh{n)z let us 
consider its equivalent algorithm for the output, for example, when M — 4: 



y(n) = h(0)x(n) + h(l)x(n - 1) + h{2)x{n - 2) 
+ hO)x{n - 3) + h{A)x(n - 4) 



(6.5) 



We have already discussed one structure employed to implement this algorithm 
in Chapter 5, and because the coefficients of the multipliers in it are directly 
available as the coefficients h(n) in H{z), it is called the direct form I structure 
and is shown in Figure 6.1. 

Whenever we have a structure to implement an FIR or an IIR filter, an equiv- 
alent structure can be obtained as its transpose by the following operations: 

1. Interchanging the input and the output nodes 

2. Replacing adders by pickoff nodes and vice versa 

3. Reversing all paths 

Using these operations, we get the transpose of the structure of Figure 6.1 
as Figure 6.2. This is known as direct form II structure; remember that this 
(direct form II) structure will be called direct form I transposed structure in the 
next chapter. 



X(z) 



h(0) 



h(1) 



h(2) 



h(3) 



© — 4) — -& 



h(4) 



-Y(z) 



Figure 6.1 Direct form I of an FIR filter. 
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h{4) 



A 



h{3) 



A 



h{2) 



A 



Y(z) 



h(1) 



A 



h(0) 



X(z)J 1^ [ 

Figure 6.2 Direct form II of an FIR filter. 



Example 6.2: Cascade Form 



If we have an FIR filter of high order, it may be realized as a cascade of FIR 
filters of lower order, preferably as second-order filters when the order is even or 
the cascade of second-order filters and one first-order filter when the order is odd. 
We factorize the given FIR filter function = J2n=of^M^~" *e form 



Hiz) = 



when M is even 



/i(0) [(1 + h{\Q)z~^) niti ^^'^ (1 + h{lm)z-^ + h(2m)z-^) 

when M is odd 



(6.6) 



A cascade realization of this equation when M = 5 is shown in Figure 6.3, and 
its transpose is shown in Figure 6.4. 



h(10) 




■0-^Y(z) 



Figure 6.3 Cascade connection of an FIR filter. 
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Figure 6.4 Transpose of the cascade connection shown in Figure 6.3. 



Example 6.3: Polyphase Form 

This realization is based on the polyphase decomposition of the FIR transfer 
function and is illustrated by choosing the following example: 

Hiiz) = h{0) + /!(l)z-i + h(2)z-^ + h{3)z-^ + h(A)z-^ 

+ h(5)z-^ + h{6)z-^ + h(l)z-^ + h(8)z-^ (6.7) 

This can be expressed as the sum of two subfunctions, shown below: 

Hiiz) = [h{0) + h{2)z-^ + h{A)z-^ + h{%)z-^] 

+ [/!(l)z-' + hO)z-^ + h(5)z-^ + h(l)z-^] 
= [h{0) + h(2)z-^ + h(4)z-* + /z(8)z-^] 

+ z"' [h(l) + h{3)z~^ + h{5)z-^ + h(l)z-^] (6.8) 

Let us denote Ao(z) = [h{0) + h(2)z~^ + /i(4)z"'* + h{?,)z~^] and 
Ai(z) = [h(l)z-^ + h(3)z-^ + h(5)z~^ + /z(7)z~^] 
= z"' [HI) + hi3)z-^ + h{5)z-^ + h{l)z-^] 

Since the polynomials in the square brackets contain only even-degree terms, 
we denote Ao(z) — Aq{z^) and Ai(z) — z^^Ai(z^). Hence we express Hi{z) — 
^o(2^) + z~^A\{z^). A block diagram showing this realization is presented in 
Figure 6.5(a), where the two functions Ao(z^) and Ai(z^) are subfilters connected 
in parallel. 
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These filters can be realized in either the direct form I or direct form II as 
described earlier and illustrated in Figures 6.1 and 6.2, respectively. But there 
would be 8 unit delays in building Ao(z) and 7 unit delays in z~'Ai(z), which 
adds up to 15 unit delay elements. We prefer to realize a circuit that would 
require a minimum number of unit delays that is equal to the order of the filter. 
A realization that contains the minimum number of delays is defined as a canonic 
realization. To reduce the total number of delays to 8, we cause the two subfilters 
to share the unit delays in order to get a canonic realization. Such a circuit 
realization is shown in Figure 6.6. 

Example 6.4 

Consider the same example and decompose (6.7) as the sum of three terms: 

Hiz) = [HO) + hO)z-^ + h{6)z-^] + [h{\) + h{A)z-^ + h{l)z'^] 
+ [h{2) + h{5)z-^ + ft(8)z-^] 
= B^iz^) + z-ifiiCz^) + z-'B2(z^) (6.9) 

A block diagram for implementing this decomposition is shown in Figure 6.5b. A 
canonic realization of (6.9) is shown in Figure 6.7 and its transpose in Figure 6.8, 
each of which uses 8 unit delay elements. The FIR filter of order 8 chosen 
in (6.7) can be decomposed as the sum of four subfilters in the form H{z) = 
Coiz'^) + Ciiz"^) + C2iz'^) + C3(z^) and can be realized by a canonic circuit. 

In general, an FIR function of order (i.e. h{n) = 0 for n > N) can be 
decomposed in the polyphase form with M subfilters connected in parallel as 
foUows 

M-l 

Hiz)=J2z~'"E'niz'') (6.10) 

where 

(N+l)/M 

E^iz)= J2 hiMn + m)z-" (6.11) 

n=0 

6.2.1 Lattice Structure for FIR Filters 

FIR filters can be realized in structures called lattice structures shown later in 
the chapter in Figure 6.17a and its transpose, in Figure 6.17b — for an example 
of a third-order filter. We will describe the design of these structures using a 
MATLAB function in Section 6.5. 
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Figure 6.7 Polyphase structure of an FIR filter function H2(z). 



6.2.2 Linear Phase FIR Filter Realizations 

When the FIR filter has a hnear phase, its coefficients are symmetric or antisym- 
metric, and hence the number of multipliers is reduced by almost half. For the 
symmetric FIR filter of order A^, the samples of the unit impulse response that 
are the same as the multiplier coefficients satisfy the condition h{n) — h{N — n) 
and it known as a type I FIR filter. The FIR filter with antisymmetric coefficients 
satisfies the condition h{n) — —h(N — n) and is known as the type U FIR filter. 

Example 6.5 

Let us consider the example of a type I FIR filter, of order N — 6: 

H^(z) = h(0) + /!(l)z-i + h{2)z-^ + h(3)z-^ + h(A)z-'^ + h{5)z-^ + h{6)z-^ 

(6.12) 

= h(0) + /!(l)z~' + h{2)z~^ + h(3)z~^ + h(2)z~'^ + h{\)z'^^ + h{Qi)z-^ 
= h(0){\ + z-^) + h{\)(z-^ + z-^) + h{2)(z-^ + z-4) + h{3)z-^ (6.13) 



By sharing the multipliers, we get the realization shown in Figure 6.9, which 
uses only four multipliers. It is still a canonic realization that uses six delay 
elements. 



FIR FILTER REALIZATIONS 31 1 



X(Z) 



h(2 



h(5 



h(8: 



h(7: 



h(4; 



h(1 



h(6: 



h(3: 



h(o: 



Figure 6.8 Transpose of the polyphase structure shown in Figure 6.7. 
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Figure 6.9 Direct-form structure of type I hnear phase FIR filter function Ht,(z). 
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I .0 .0 .0 ^Y(z) 

Figure 6.10 Direct-form structure of type II linear phase FIR filter function H^iz). 

Example 6.6 

If we consider a type II FIR filter of order 7, its transfer function is given by 

H4(z) = h(0) + hil)z~^ + h{l)z~^ + h(3)z~^ + h(3)z~'^ + h(2)z~^ 

+ h(\)z-^ + h{Q)z''' (6.14) 
= + z-^) + + z-^) + h(2)(z-^ + z~^) 

+ /z(3)(z-3 + z-4) (6.15) 

This is realized by the canonic circuit shown in Figure 6.10, thereby reducing 
the total number of multipliers from 7 to 4. Similar cost saving is achieved in 
the realization of FIR filters with antisymmetric coefficients. 

6.3 IIR FILTER REALIZATIONS 

In constructing several equivalent structures of an FIR filter, we used the direct- 
form decomposition of the filter transfer function as the product of second-order 
sections connected in cascade, polyphase decomposition, and transpose for each 
structure obtained by them. We used the symmetry of the coefficients of linear 
phase FIR filters to reduce the number of delay elements. We can also generate 
their transpose forms. Using similar strategies, in this section we present several 
structures for the IIR filters. 
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Example 6.7: Direct Forms 

The transfer function (6.1) of an IIR filter is the ratio of a numerator polynomial 
to a denominator polynomial. First we decompose it as the product of an all-pole 
function Hi(z) and a polynomial H2{z) 



H(z) 



1 + Ell a(n)z-" 
= Hi(z)H2iz) ■■ 



1 + E„=i «(«)z-" 



M 



Y,b{n)z-'' 



.n=0 



(6.16) 



(6.17) 



and construct a cascade connection of an FIR filter H2iz) and the all-pole IIR 
filter H\{z). Again we select an example to illustrate the method. Let H2{z) — 
bo + b{\)z-^ + b{2)z-^ + Z?(3)z-3 and 



Hi{z) = 



1 



1 + a(l)z-i + a(2)z-2 + a(3)z-3 



The realization of i/i(z) in direct form 1 is shown in Figure 6.11 as the filter 
connected in cascade with the realization of the FIR filter H2{z) also in direct 
form I structure. The structure for the IIR filter is also called a direct form 
I because the gain constants of the multipliers are directly available from the 
coefficients of the transfer function. 

We note that Hi(z) = V{z)/X{z) and H2{z) = Y{z)/V{z). We also note that 
the signals at the output of the three delay elements of the filter for H\(z) are 



X(z)- 



^ -a(2) 



-a(3) 



V(z) 



"(n-l) "(n-l) 



"(0-2) V(n_2) 



"(0-3) V(n_3) 



i> <0 ^Y(z) 



Figure 6.11 Direct form I of an IIR filter. 
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X(Z) 




Figure 6.12 Direct form II structure of an IIR filter. 

the same as those at the output of the three delay elements of filter H2{z). Hence 
we let the two circuits share one set of three delay elements, thereby reducing 
the number of delay elements. The result of merging the two circuits is shown 
in Figure 6.12 and is identified as the direct form II realization of the IIR filter. 
Its transpose is shown in Figure 6.13. Both of them use the minimum number 
of delay elements equal to the order of the IIR filter and hence are canonic 
realizations. 

The two filters realizing H\{z) and H2{z) can be cascaded in the reverse order 
[i.e., H{z) — H2{z)Hi{z)], and when their transpose is obtained, we see that 
the three delay elements of H2(z) can be shared with Hi(z), and thus another 
realization identified as direct form I as well as its transpose can be obtained. 

Example 6.8: Cascade Form 



The filter function (6.16) can be decomposed as the product of transfer functions 
in the form 



H(z) = 



Ni(z)N2(z)---NKiz) 
Di(z)D2{z)D^iz)---DK(.z) 



Ni(z) 
Di(z) 



N2(Z) 
D2(Z) 



^Hi{z)H2(z)H3(z)- 



Diiz) 
■Hk(z) 



Dk(z), 



(6.18) 

(6.19) 
(6.20) 
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-a(2) 



-Y(z) 



Figure 6.13 Direct form II transposed structure of an IIR filter. 



where K = N/2 when is even and the polynomials Di(z), D2(z), D^{z), and 
so on are second-order polynomials, with complex zeros appearing in conjugate 
pairs in any such polynomial. When is odd, K — (N — 1) /2, and one of the 
denominator polynomials is a first-order polynomial. The numerator polynomials 
Ni(z), N2(z), ■ ■ ■ may be first-order or second-order polynomials or a constant: 



Hiz) = Ho 



1 + auz~ 



n 



1 + filkZ-^ + p2kZ- 

l + aikz-^ +oi2kZ- 



(6.21) 



Each of the transfer functions H\{z), H2{z), ■ ■ ■ , Hk(z) is realized by the direct 
form I or direct form II or their transpose structures and then connected in 
cascade. They can also be cascaded in many other sequential order, for example, 
H(z) = Hi(z)H,{z)H5(z) ... or H{z) = H2{z)H,{z)H^{z)H^{z) .... 

There are more choices in the realization of H{z) in the cascade connection in 
addition to those indicated above. We can pair the numerators N\{z), N2{z), ■ ■ ■ 
and denominators Z)i(z), D2(z), D^{z), . . . in many different combinations; in 
other words, we can pair the poles and zeros of the polynomials in different 
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ways. For example, we can define 



D2(Z)_ 

NiizT 
Di(z)_ 
Nk(z) 
Diiz) 



D3iz)_ 

N^izT 
Da{z)_ 

' N2{zy 

.D3{Z), 



N^iz.)' 
Ddz)_ 
N.iz) ' 
D3iz)_ 

'mzY 

.Dliz), 



Nk(z) 
Di(z) 
Nkiz) ' 
Dliz), 



and cascade them in many different orders. 

So the number of realizations that can be obtained from a nominal IIR transfer 
function is very large, in general. Besides the difference in the algorithms for 
each of these realizations and the consequent effects of finite wordlength when the 
coefficients of the filter and the signal samples are quantized to a finite number, 
we have to consider the effect on the overall magnitude of the output sequence 
and the need for scaling the magnitude of the output sequence at each stage of 
the cascade connection and so on. 

Example 6.9 

Consider a simple example of an IIR filter as follows: 

z(0.16z-0.18) 



Hiz) = 



(z - 0.2)(z + 0.1)(z + 0.4)(z2 + z + 0.5) 
A few alternate forms of expressing this are given below: 



Hiz) = 



1 



(z2 - O.lz - 0.02) 

z 



(0.16Z-0.18) 
(z2 + z + 0.5) 



(z + 0.4). 



1 



(z2 -O.lz-0.02). 



(0.16Z-0.18) 
(z2-0.1z-0.02) 

z 

(z2 + z + 0.5). 



(z + 0.4) 

(0.16Z-0.18) 
(z2 + z + 0.5) , 
1 



(6.22) 



(6.23) 



(z2 + z + 0.5) 



(z + 0.4) 



1 



(z + 0.4) 



(0.16Z-0.18) 
(z2-0.1z-0.02) 



(6.24) 



Let us choose the last expression, (6.24), and rewrite it in inverse powers of z, 
as given by 



H{Z-') = 



1 + z-i + 0.5z- 



(0.16z~^ -0.18z~^) " 
(l + 0.4z-i)J L(l -O.lz-i -0.02Z-2) 

(6.25) 
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0.02 _0.18 



Figure 6.14 Cascade connection of an IIR filter. 



One of the realizations used to implement this transfer function is shown in 
Figure 6.14. 

Instead of combining the factors (z — 0.2) and (z + 0.1) and getting (z^ — 
O.lz — 0.02), in the denominator of (6.22), we can combine (z — 0.2) and (z + 
0.4) or (z + 0.1) and (z + 0.4) to generate new second-order polynomials and 
select many pole-zero pairs and order of second-order sections connected in 
cascade, adding to the many possible realizations of (6.22) in the cascade form. 
The cascade connection of second-order sections, each realized in direct form II, 
has been a popular choice for a long time and was investigated in great detail, 
until other structures became known for their better performance with respect to 
finite wordlength effects and practical applications. 



Example 6. 10: Parallel Form 



The IIR transfer function can also be expanded as the sum of second-order 
structures. It is decomposed into its partial fraction form, combining the terms 
with complex conjugate poles together such that we have an expansion with real 
coefficients only. We will choose the same example as (6.22) to illustrate this 
form of realization. 

One form of the partial fraction expansion of (6.22) is 

, 5.31165Z l.lUz 5.21368Z l.lSWz^ - 0.15947z 

n(z) = 1 (6.26) 

z + 0.1 z-0.2 z + 0.4 z2 + z + 0.5 



By combining (z + 0.1), (z — 0.2), (z + 0.4) in different pairs to get the cor- 
responding denominator polynomials, we get the following expressions for the 
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transfer function given above: 

0.9797z2 + 1.6033Z l.lllz l.BHz^ - 0.15947z 
~ z2 + 0.5z + 0.04 " 7^02 ^ z^ + z + 0.5 *■ ^' 

_ -6.3248z2 + 0.5983z 5.31165 l.BMz^ - 0.15947z 

z2 + o.2z-0.08 z + 0.1 z^ + z + 0.5 ^' 

_ 4.200z2 - 1.1173Z 5.2134Z 1.1314z^ - 0.15947z 

z2-0.1z-0.02 ~ z + 0.4 z2 + z + 0.5 *- ' 

The three terms in these expressions are rewritten in inverse powers of z, and 

any one of the IIR realizations (direct form or their transpose) is used to obtain 
the circuit for each of them, and they are connected in parallel. Let us select the 
last expression: 

_ 4.200z2 - 1.1173Z 5.2134Z l.UlAz^ - 0.15947z 
~ z2-0.1z-0.02 ~ z + 0.4 z2 + z + 0.5 

4.200- 1.117z"^ 5.2134 1.1314 - 0.1594z-i 

+ . , , , (6.30) 



1 - O.lz-i - 0.02Z-2 1 + 0.4Z-1 1+Z-1+0.5Z-2 

Figure 6.15 shows a reaUzation of the filter given by (6.30) in the parallel 
form of connection, and by using the transpose of each sections, a new circuit 
can be derived. 

Another form of expanding the transfer function is the normal form of partial 
fraction expansion, indicated by 



z + 0.1 z-0.2 z + 0.4 z2 + z + 0.5 

Riz-' Riz-' RjZ-' Raz-'+Rsz-^ 

1 + O.lz-i 1-0.2Z-1 1 + 0.4Z-1 1 + Z-1+0.5Z-2 

which gives rise to additional structures. 

So, the transfer function given by (6.22) was decomposed in the form of (6.25) 
and realized by the cascade structure shown in Figure 6.14; it was decomposed in 
the form of (6.30) and realized by the parallel connection in the structure shown 
in Figure 6.15. 

The algorithm used to implement the structure in Figure 6.14 is of the form 

yi{n) =x{n)- y\{n - 1) - 0.5^1 (n - 2) 
yiin) = yiin) - 0.4^2 (n - 1) 
yjin) = yiin) + O.ly^in - 1) + 0.023;3(« - 2) 
yin) = O.iey^in - 1) - 0.18y3(n - 2) 
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-0.5 

Figure 6.15 Parallel connection of the IIR filter function H{z). 



whereas the algorithm employed to implement the structure shown in Figure 6.15 
has the form 

yi{n) ^x{n) + 0.1yi(« - 1) + 0.02yi(n - 2) 
y2(n) = 4.2yi(n)-1.117yi(«-l) 
yi{n)^x{n)-OAy^{n- 1) 
y^{n) = x{n) - y^in - 1) - QSy^in - 2) 
Jiin) = 1.131454(n) - 0.1594y4(« - 1) 
y(n) = y2{n) + 5.2134y3(«) + Jsin) 

Remember that under ideal conditions both algorithms give the same output 
for a given input signal and the two structures realize the same transfer function 
(6.22). But when the two algorithms have to be programmed and implemented 
by hardware devices, the results would be very different and the accuracy of 
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the resulting output, the speed of the execution, and the throughput, and other 
factors would depend not only on the finite wordlength but also on so many 
other factors, including the architecture of the DSP chip, program instructions 
per cycle, and dynamic range of the input signal. We will discuss these factors 
in a later chapter. 



6.4 ALLPASS FILTERS IN PARALLEL 

Next in importance is the structure shown in Figure 6.16. The transfer function 
G(z) = Y(z)/X(z) is given by j[Aiiz) + Ajiz)], where Ai(z) and ^2(2) are 
the allpass filters connected in parallel. But in this figure, there is another trans- 
fer function, H{z) = V{z)/X{z), which is given by Hiz) = j[Aiiz) - ^2(2)]. 
The structure shown in Figure 6.16 is also called the lattice structure or lattice- 
coupled allpass structure by some authors. A typical allpass filter function is of 
the forni 



A(z) 



N(z) _ _^an + an-iz ^ -V an-iz 'h V a\z + aoz 

D{z) ao + a\z~^ + a2Z~^ H h <3„-iz~"+' + anZ~'' 



(6.32) 



which shows that the order of the coefficients in the numerator is the reverse of 
that in the denominator, when both the numerator and denominator polynomial 
are expressed in descending powers of z. Equation (6.32) can be expressed in 
another form as 



A(z) = 



z "(flo + aiz + fl2Z H |-a„-iz" + i3«z") 



ao + aiz ' + <32Z ^ + ■ 

z-"£>(z-') 
D{z) 



+ an-iz-"+^ + anZ-" 



(6.33) 



The zeros of the numerator polynomial D(z~') are the reciprocals of the zeros 
of the denominator D{z), and therefore the numerator polynomial D{z~^) is the 
mirror image polynomial of D{z). 

When the allpass filter has all its poles inside the unit circle in the z plane, it is 
a stable function and its zeros are outside the unit circle as a result of the mirror 




Figure 6.16 Two allpass filters in parallel (lattice-coupled allpass structure). 
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image symmetry. Therefore a stable, allpass filter function is a non-minimum 
phase function. 

Letting — 1, we get the magnitude response of this filter to be a constant at 
all frequencies, because the numerator is the complex conjugate of the denom- 
inator. Since this filter transmits all frequencies with the same gain, it is called 
an allpass filter: 



But the phase response (and the group delay) is dependent on the coeffi- 
cients of the allpass filter. We know that the phase response filter designed 
to approximate a specified magnitude response is a nonlinear function of o), 
and therefore its group delay is far from a constant value. When an allpass fil- 
ter is cascaded with such a filter, the resulting filter has a frequency response 
Hi(e-'"')A(e-'"') = |7^i(e-'")A(e>)| gil'^M+'AMJ = |7/i(e>)| g J MJ. So the 
magnitude response does not change when the IIR filter is cascaded with an all- 
pass filter, but its phase response 0(co) changes by the addition of the phase 
response (pico) contributed by the allpass filter. The allpass filters A{z) are there- 
fore very useful for modifying the phase response (and the group delay) of filters 
without changing the magnitude of a given IIR filter H\{z), when they are cas- 
caded with Hi iz). However, the method used to find the coefficients of the allpass 
filter A{z) such that the group delay of H\{z)A{z) is a very close approximation 
to a constant in the passband of the filter H\ (z) poses a highly nonlinear problem, 
and only computer-aided optimization has been utilized to solve this problem. 
Normally IIR filters are designed from specifications for its magnitude only, and 
its group delay is far from a linear function of frequency. There are many appli- 
cations that call for a constant group delay or a linear phase response, and in 
such cases, the filters are cascaded with an allpass filter that does not affect its 
magnitude — except by a constant — but is designed such that it compensates for 
the phase distortion of the IIR filter. Allpass filters designed for this purpose are 
cascaded with the IIR filters and are known as delay equalizers. 

An important property of allpass filters is that if the coefficients change in 
wordlength, the magnitude response of an allpass filter at all frequencies does 
not change. Recall that a second-order allpass filter was analyzed in Chapter 2, 
and that if the transfer function of an allpass filter is of a higher order, it can 
be realized by cascading second-order filters and possibly one first-order allpass 
filter. We illustrate a few more structures that realize first-order aUpass trans- 
fer functions as well as second-order allpass functions later in the chapter, in 
Figures 6.23 and 6.24. 

Let us assume that the two allpass filters shown in Figure 6.16 are of order 
(A^ — r) and r, respectively, and are given by 



A(e^")| = 



1 -I- aie^"^ + aiej^ + •••+ a„ej' 



= 1 



(6.34) 



1 -I- aie-j'^ + aie-i'^ H h a„e-^' 



Ai(z) = 



z-(^-)Di(z-^) 



(6.35) 
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and 



A2(Z) = 



Diiz) 



(6.36) 



Substituting them in G(z) = ^[Aiiz) + Axiz)] and Hiz) = ^[Aiiz) - Axiz)], 
we get 



Giz) = i 



z-(^-'-)£>i(z-i)Z)2(z) + z-'-£>2(z-^)Oi(z) 
Diiz)D2iz) 



(6.37) 



and 



H(z) = - 



z-(^-'-)Diiz-')D2iz) - z--D2{z-')Diiz) 



Di{z)D2(z) 



If we express them in the form as 



and 



G(z) = 



Hiz) = 



D(Z) Diz) 



Q(Z) ELoInZ-" 



D(z) 



D(z) 



(6.38) 



(6.39) 



(6.40) 



then it can be shown that the following conditions are satisfied by (6.37) and 
(6.38). 

Property 6.1 Piz~^) = z'^ Piz). Hence p„ = pN-n, that is, the coefficients of 
P{z) are symmetric. 

Property 6.2 Q{z~^) = —z^Qiz)- Hence ^„ = —qi^-„, that is, the coefficients 
of Q{z) are antisymmetric. 

Property 6.3 P(z)Piz-^) + Qiz)Q(z~^) = D(z)Diz-^). Hence 



\Giej'")\ +\HieJ'")\ =1 



(6.41) 



in other words, G(z) and H(z) are said to form a power complementary pair. 

In the next chapter the structure for realizing G(e'"') will be termed a lattice- 
coupled allpass filter and because of the property stated here, the structure for 
realizing H{e^'") wiU be called a lattice-coupled allpass power complementary 
filter. 
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Property 6.4 

\G{e^'^)\ = \ je^'^i^") + = i |l + e^'(«i(<»)-^2(<»)| < j (6.42) 

where Ai(e>) = e-'^^i^'^' and AiCe^"') = e^^^'^^ . 

In the following analysis, we will assume that the four conditions described 
above are satisfied by G(z) and H{z) and derive the results that they can be 
obtained in the form G(z) = \ [Ai(z) + ^2(2)] and H{z) = \ [Ai(z) - AaCz)]. 

Consider Property 6.3: P{z)P{z~^) + Q{z)Q{z~^) = D{z)D{z-^). Using 
Properties 6. 1 and 6.2, we get 

P(z)z^P(z) - z^Q{z)Q{z) = D{z)D{z-^) (6.43) 
P^{z) - Q^{z) = D{z)z-^ D{z-^) (6.44) 
[P{z) + Q{z)] [P{z) - Q(z)] = z-'' D{z)D{z-^) (6.45) 

From Properties 6.1 and 6.2, we have [P{z~^) + Q{z~^)\ = z^ [P(z) - Q{z)] 
and therefore z"^ [Piz~^) + Q(z~^)] = [P(z) - Q(z)l and we get 

\.P(z) + Qiz)] [P(z) - Qiz)] = P\z) - Q\z) (6.46) 
From (6.44), we have 

P^iz)- Q^{z) = D{z)z-'' D{z-^) (6.47) 

iP{z) + ea)] z"^ [P{z-') + Qiz-')] = £)(z)z-^D(z-i) (6.48) 

Therefore 

IPiz) + Qiz)] [P(z) - Qiz)] = z-" D{z)D{z-^) (6.49) 

This shows that the zeros of [P{z) — Q{z)] are reciprocals of the zeros of 
[P{z) + Qiz)]. 

It has been found that the Butterworth, Chebyshev, and elliptic lowpass filters 
of odd order satisfy the four properties described above. We know from Chapter 4 
that their transfer function G(z) obtained from the bilinear transformation of 
the analog lowpass prototype filters has no poles on the unit circle. In other 
words, the zeros of D{z) are within the unit circle, and therefore the zeros of 
D{z~^) are outside the unit circle, because they are the reciprocals of the zeros 
of D(z). From (6.49) we see that the zeros of [P(z) + g(z)] and [P(z) - Q{z)] 
caimot lie on the unit circle. Let us assume that {P{z) + Q{z)] has r zeros 
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Zi^{k = 1,2,3, ... ,r) that are inside the unit circle and {N — r) zeros Zjij = 
r + \,r + 2, . . . ,N) that are outside the unit circle. Therefore [P{z) — Q{z)] 
has r zeros z^^(k — 1,2,3, ... ,r) outside the unit circle and (A^ — r) zeros 
{j = r + \,r + 2, . . . , N) inside the unit circle. From (6.49), we can therefore 
assume that D{z) that has all its zeros inside the unit circle is of the form 



D{.z) = 



j=r+l 



(6.50) 



and 



[Piz) + Q(z}] [P(z} - Q(z)] = z-'^ D{z)D{z-^) 



Y\{i-z-\k) n i^-z~'zf) 

j=r+l 



k=l 



Yi(^~' - zk) n - ^7') 

j=r+l 



(6.51) 



Thus we identify 

r N 

Piz) + Qiz) = aY[(l-z-'zk) n (^"'-^7') 

k=l j=r+l 
J r N 

Piz) - Qiz) = - Y[iz-' - Zk) n (1 - ^"'^7') 



(6.52) 



(6.53) 



k=l 



Then 



j=r+l 



Giz) + H(z) = ^^^^^^ = « n ( i—i^ ) = ^^^^'^ (6.54) 

j=r+l \1 ^ / 



G(z) - Hiz) = 



D{Z) 

P(z) - Qiz) 1 



Diz) 



k=l 



=-n(f^)=-^^(^) 

a f z ^ZkJ a 



1 



(6.55) 



But from the power complementary property, we must have = I. Therefore, 
a = 1, so that 



G(z) = i[Ai(z) + A2(z)] 
H(z) = l[Ai(z)-A2iz)] 



(6.56) 
(6.57) 



So we have proved that when Giz) is a Butterworth, Chebyshev, or elliptic 
lowpass filter of odd order (which satisfy the four properties Usted above), we 
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can decompose G(z) as the sum of two allpass functions, Ai(z)/2 and A2(z)/2. 
Once we have derived the two allpass functions, we easily obtain H(z) as the 
difference of Ai(z)/2 and A2(z)/2 and realize it by the structure of Figure 6.16. 
Because of the complementary power property, we see that H{z) realizes a 
highpass filter. 



6.4.1 Design Procedure 

The procedure to find the poles and zeros of the two allpass filters from the 
given Butterworth, Chebyshev, or elliptic lowpass filters of odd order is described 
below. We have already pointed out that the transfer function G(z) = P{z)/D(z) 
for these filters obtained from the corresponding analog prototype via the biUnear 
transformation have all their poles inside the unit circle of the z plane. Their 
magnitude response |G(e'"')| has a maximum value at en — 0, which can be easily 
obtained as the value of G(z) at z = 1. In order to satisfy Property 6.4, we have 
to divide G(z) by G(e-') or multiply G(z) by a scaling factor k = D{\)/P{\) so 
that I^GCe^'^)] < 1 as the first step in the design procedure. Let us assume that 
G(z) has already been scaled by k in our further discussion. 
From (6.47), we write 

Q^{z) = P^{z)-D{z)z-'^ D{z-^) (6.58) 



We know the numerator polynomial P(z) and the denominator polynomial D(z) 
of the filter function G(z), and hence we can compute the right side of the 
Equation 6.58. Let us denote Q^{z) = Q(z)Qiz) as Riz) = Tl^o''nZ~"- The 
coefficients of R{z) = Q{z)Q(z) are computed by convolution of the coefficients 
of Q(z) with the coefficients of Qiz): 

n 

rn = qn*qn = ^ qkqn-k (6.59) 

These coefficients can be computed recursively by the following algorithm: 

?o = y/ro (6.60) 
qi = ^ (6.61) 

En— 1 
it=l qkqn-k --1 ^ ^ A7 f£. 

qn = > 2 <n < N (6.62) 

But we need to compute q„ for only n — 0, 1,2, . . . , (N — l)/2, since these 
coefficients are antisymmetric and q„ =0 when n = {N + l)/2. 

When we have computed the coefficients q„ and constructed the polyno- 
mial Q(z) = J2n=Qqn^~" ' P(z)+ Q(z), and now we factorize it to 
find its zeros. We identify the zeros inside the unit circle as the r poles 
Zkik = 1,2,3, ... ,r) of A2(z). By reversing the coefficients of the polynomial 
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having these zeros, we get the numerator of Aiiz), which has the zeros at . 
We identify the zeros of P{z) + Q{z) that are outside the unit circle as the 
(A^ — r) zeros zjij — r + I, r + 2, . . . , N) of A\(z). By reversing the order of 
the coefficients of the numerator polynomial having these zeros, we obtain the 
denominator polynomial of Ai(z). It has (A' — r) zeros at zj' as shown in (6.54). 
This completes the design procedure used to obtain Ai(z) and A2(z) from G(z). 
An example is worked out in Section 6.5. 

6.4.2 Lattice- Ladder Realization 

Another well-known realization of an IIR transfer function of the form (6.1) is 
shown in Figure 6.19a, and is known as the lattice-ladder realization. It is also 
called the autoregressive moving-average (ARMA) model in the literature on 
speech processing, adaptive filters, and signal processing in general. When the 
numerator of (6.1) is a constant, we have an all-pole model also known as the 
autoregressive (AR) model, and the structure to realize a third-order AR model 
is shown in Figure 6.19b, whereas when the denominator is a constant, we get 
an FIR model called the moving-average (MA) model. The structure shown in 
Figure 6.17a is the model for a third-order FIR filter function or the MA model, 
and the structure in Figure 6.17b is its transpose. We do not present the theoreti- 
cal analysis of lattice structures for these models as it is beyond the scope of this 
book but explain the use of a MATLAB function tf 2latc in the next section to 
derive the structures. This function implements the theoretical procedure, and 
for the ARMA model, it gives the N lattice parameters kt, i — 1,2, . . . , N 
and also the values of the N + I ladder coefficients d,, i — 0, I, . . . , N . But 




{b) 

Figure 6.17 (a) Lattice structure for an FIR filter; (b) transpose of the lattice structure 
for the FIR filter in (a). 
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in Figure 6.19a, the value of the ladder coefficient V5 happens to be zero for the 
numerical example, and therefore the multiplier ^5 is zero. The lattice parameters 
are also known as the reflection coefficients, and it has been shown that the poles 
of the IIR filter function are inside the unit circle of the z plane if |^, | < 1. So 
this method is used to test whether an IIR filter is stable. 



6.5 REALIZATION OF FIR AND IIR FILTERS USING MATLAB 

Many of the computations involved in the realization of FIR and IIR filters as 
presented in this chapter can be carried out by MATLAB functions. For example, 
an FIR filter realization in the cascaded structure can be obtained by finding the 
roots of the transfer function and then finding the second-order polynomials with 
complex conjugate pair of the roots or a pair of two real zeros. 

To find the roots of a polynomial H{z) = ^^=0 b(n)z~'', we use the MATLAB 
function r = roots (b) where the vector b = [b(0), b(i), b(2), ••• 
b (N) ] and R is the vector of the N roots. Choosing a pair of complex conju- 
gate roots or a pair of real roots, we construct the second-order polynomials 
using the MATLAB function Pjc=poly (R^) , where R^ is the list of two roots and 
Pk is the vector of the coefficients of the second-order polynomial. Of course, if 
H(z) is an odd-order polynomial, one first-order polynomial with a single real 
root will be left as a term in the decomposition of H(z)- 

Example 6.11 

Using the MATLAB commands 

b = [1.965 -3.202 4.435 -3.14 1.591 -0.3667]; 
R= roots (b) 

we get the roots 

0.2682 + 0.8986i 
0.2682 - 0.89862 
0.3383 + 0.6284i 
0.3383 - 0.6284i 
0.4166 

Then we continue 

Rl= [0.2682 + 0.8986*1 0.2682-0.8986*1] ; 

Pl=poly (Rl) 
Pl= 

1.0000 -0.5364 0.8794 

R2= [0 . 3383+0 . 6284*i 0.33 83-0.6284*1] ; 
P2=poly (R2) 
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P2 = 

1.0000 -0.6766 0.5093 

Hence, if Hiz) = 1.965 - 3.202z-i + 4.435z-2 - S.Uz'^ + 1.5912"'^ - 
0.3667z~^, we construct a polynomial in positive powers of z and the coefficient 
of the highest-degree term normalized to unity: 

N{z) = [1.965z^ - 3.202z^ + 4.435z^ - 3.14z2 + 1.591z - 0.3667] 
= 1.965[z^ - 1.6295z'* + 2.257z^ - 1.598z^ + 0.8096z - 0.1866] 

From the output data for the coefficients of Pi and P2 displayed above, we 
construct the polynomial 

Niz) = 1.965(z^ - 0.5364Z + 0.8794)(z^ - 0.6766z + 0.5093)(z - 0.4166) 

Then we get H{z) in the form 

Hiz) = 1.965(1 - 0.5364z"' + 0.8794z"^)(l - 0.6766z"' + 0.5093z"^) 
X (1 -0.4166z"^) 

Example 6. 12 

Consider the same FIR filter as given in Example 6.11. We use the simple 
MATLAB function k = tf 21atc (b) to get the vector output k listing the reflec- 
tion coefficients fc, , — 1,2,3,4,5, where b is the vector of the coefficients given 
in Example 6.11. 

The vector output k for the lattice coefficients is 

-0 . 3597 

0 . 9325 
-0 . 5745 
0 . 5238 
-0 . 1866 

and the structure of the lattice realization for the FIR filter or the MA model is 
shown in Figure 6.18, where the lattice coefficients are as listed above. 




Figure 6.18 Lattice structure for a fifth-order FIR filter. 
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Example 6. 13 

To get a cascade realization of an IIR filter, one could factorize both the numerator 
and the denominator as the product of second-order polynomials (and possibly 
one first-order polynomial) as illustrated in Example 6.9. Another approach is to 
use the MATLAB functions tf 2zp and zp2sos as explained below. 

First we use the function [z,p,k] = tf 2zp (num, den) to get the output 
vector [z,p,k] , which lists the zeros, poles, and the gain constant for the IIR 
filter. Then the function sos = zp2sos {z,p,k) gives the coefficients of the 
second-order polynomials of each section in a matrix of order L x 6 in the 
following format: 

noi nil «2i doi dn dji 
no2 tin n22 do2 dn d22 



_ noL niL «2Z, doL dn d2L _ 



The six elements in each row define the transfer function of each second-order 
section Hi (z) used in the product form as indicated below: 



L L . 

Hiz) = Y\Hi(z) = Y[( 



npi +nuz ^ +n2iZ 
X doi + duz"^ + d2iZ~^ , 

These two MATLAB functions can be used to factorize an FIR function also. 
Instead of the algorithm described above, we let the polynomial //(z) of the FIR 
filter, as the denominator polynomial of an IIR filter and the numerator, be unity. 
To illustrate this, let us consider the previous example and run the two functions 
in the following MATLAB script: 

num= 1 ; 
den=b 

[z,p,k] = tf 2zp (num, den) ; 
SOS = zp2sos (z,p,k) 

SOS = 

0 0.5089 0 1.0000 -0.4166 0 

0 0 1.0000 1.0000 -0.6766 0.5094 

0 0 1.0000 1.0000 -0.5363 0.8794 

Therefore the product form is given by 
0.5089Z-1 \ / 



1 - 0.4166Z-1 7 V 1 - 0.6766Z-1 + 0.5094z-2 

-2 



1 - 0.5363Z-1 -h 0.8794Z- 

The terms in the denominator agree with those obtained in Example 6.11, which 
used the functions roots and poly. 
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Let us illustrate the decomposition of an IIR filter as the product of second- 
order functions; consider the transfer function 

^ 0.5 + 0.2Z-1 +0.3z-^ + 0.1z-^ 

~ 1.965 - 3.202Z-1 + 4.435z-2 - 3.14z-3 + 1.591z-4 - 0.3667z-5 

(6.63) 

The MATLAB program used to obtain the factorized form to realize the cas- 
cade structure for an IIR filter is 

num= [0.5 0.2 0.3 0.0 0.1] 

den=[1.965 -3.202 4.435 -3.14 1.591 -0.3667]; 

[z,p,k] =tf2zp (num, den) ; 
sos=zp2sos (z,p,k) 

SOS = 

0 0.2545 0 1.0000 -0.4166 0 

1.0000 0.8204 0.6247 1.0000 -0.6766 0.5094 

1.0000 -0.4204 0.3201 1.0000 -0.5363 0.8794 

Using the entries in this sos matrix, we write the factorized form of H(z) as 
follows: 



/ 0.2545Z-' \ n+0. 
Vl -0.4166Z-1 / VI -0. 



8204Z-1 + 0.6247 z- 



6766Z-1 -F0.5094z-2^ 
-0.4204Z-1 -F0.3201z-2\ 



/1-a 
Vl-0. 



5363Z-1 -F0.8794Z-2, 



(6.64) 



Note that the numerator in this expression seems to be a fifth-order polynomial 
in inverse powers of z whereas the numerator of the transfer function (6.63) 
is a fourth-order polynomial. But the factorization of a polynomial is carried 
out when it is expressed in positive powers of z since the polynomials are of 
the form f|(z — z,), where z, are the zeros. So when the preceding factorized 
form is converted to the ratio of polynomials in positive powers of z, we get a 
fourth-order numerator polynomial and the fifth-order denominator: 

0.2545 \ /z^ + 0.8204Z -j- 0.6247\ / - 0.4204z + 0.3201 \ 



z - 0.4166 / \z^ - 0.6766Z + 0.5094 / \z^ - 0.5363z + 0.8794 / 

0.5z'^ + 0.2z^ + 0.3z^ + 0.l 

~ 1.965z5 - 3.202z4 + 4A35z^ - 3.Uz^ + 1.591z - 0.3667 

This agrees with the result of expressing H{z) as the ratio of a fourth-order 
numerator polynomial and a fifth-order denominator polynomial in positive pow- 
ers of z. So care is to be talcen to express the transfer function in positive powers 
of z and then checlc the results after constructing the factorized form, because the 
function zp2sos works only if the zeros are inside the unit circle of the z plane. 
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But the factorized fomi of H(z) constructed from the sos matrix leads us cor- 
rectly to the next step of drawing the realization structures for each section, for 
example, by the direct form, and connecting them in cascade. Such a realization 
is similar to that shown in Figure 6.14. 

Example 6.14 

In the previous chapter, we used the function [r,p,k] = residuez {num,den) 
to find the zeros, poles, and the gain constant of an IIR filter function H(z). Now 
we can select the two residues in a vector [ rk ( i ) rk ( 2 ) ] and the corresponding 
poles [pk ( 1 ) pk ( 2 ) ] in a complex conjugate pair or two real poles at a time 
to construct the numerator and denominator of each section in the vector form 
[bk, ak] . Then we express the IIR function H(z) as the sum of such second-order 
functions — with one first-order section if H(z) has an odd number of poles. We 
consider the same function H{z) given by (6.63) to realize the parallel structure. 

b = 

0.5000 0.2000 0.3000 0 0.1000 
a = 

1.9G50 -3.2020 4.4350 -3.1400 1.5910 -0.3667 
[r , p, k] =residuez (b, a) 
r = 

-0.1632 - 0.1760i 
-0.1632 + 0.1760i 
0.1516 - 0.0551i 
0.1516 + 0.0551i 
0.2777 
P = 

0.2682 + 0.8986i 
0.2682 - 0. 89861 
0.3383 + 0. 62841 
0.3383 - 0.62841 
0.4166 
k = 
[] 

rl = 

[-0.1632 + 0. 17601 -0.1632-0.17601] 

pi = 

0.2682 - 0.89861 0.2682+0.89861 
r2 = 

[0.1516 - 0.05511 0.1516 + 0.05511] 

p2 = 

0.3383 + 0.62841 0.3383 - 0.62841 
[bl, al] =residuez (rl,pl, 0) 

bl = 

-0.3264 0.4038 0 
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al = 

1.0000 -0.5364 0.8794 
[b2 , a2] =residuez (r2,p2 , 0) 
b2 = 

0.3032 -0.0333 0 

a2 = 

1.0000 -0.6766 0.5093 



The residue and the third pole are 0.2777 and 0.4166. So we construct the transfer 
function H{z) as the sum of three terms 

-0.3264 + 0.4038Z-1 0.3032 - 0.0333z-i 



1 - 0.5364Z-1 + 0.8794Z-2 1 - 0.6766z-i + 0.5093z-2 
0.2777 
1 -041662 



+ — ^TTTTTzr- (6-65) 



The structure found in realizing the parallel connection is similar to that shown 
in Figure 6.15. 

Example 6. 15 

We used the MATLAB function k = tf 21atc (num) to obtain the lattice real- 
ization of an (MA) FIR filter in Example 6.12. It is a special case of the more 
general function [k,v] = tf 2latc (num, den) used to obtain the lattice-ladder 
(ARMA) realization of an IIR filter, where k is the vector of the lattice coeffi- 
cients (reflection coefficients) and the vector v gives the ladder coefficients — an 
example of which is shown in Figure 6.19a. Note that the lattice coefficients 
are in reverse order (i.e., they are shown from right to left) of that shown in 
Figure 6.17a; also note that the number of lattice coefficients in Figure 6.18(a) is 
N but the number of the ladder coefficients is -I- 1 . Another special case is the 
function k = tf21atc(i, den) , which gives the lattice coefficients of an all-pole 
(AR) IIR filter. A structure for a third-order AR model is given in Figure 6.19b. 
Note the difference in the structure for this AR model and the structures for the 
FIR filter that is defined as the MA model shown in Figure 6.17. 

Let us consider the transfer function H(z) given in (6.63) to obtain its 
lattice-ladder realization. We use the following MATLAB function [k,v] = 
tf 21atc (num, den) and get the vector outputs k and v immediately. The struc- 
ture for this realization is shown in Figure 6.19a, where the values of the lattice 
and ladder coefficients are as follows: 



b = [ 0.5000 0.2000 0.3000 0 0.1000]; 

a= [ 1.9650 -3.2020 4.4350 -3.1400 1.5910 -0.3667]; 
[k,v] = tf21atc(b,a) 
k = 

-0.3597 
0.9325 
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Figure 6.19 (a) Lattice-ladder structure for an IIR filter (ARMA model); (b) lattice 
structure for an all-pole IIR filter Y{z)/X{z) (AR model) and an allpass filter V{z)/X(z). 



-0 . 5745 
0 . 5238 
-0 . 1866 
V = 
0 . 3831 
0 .3164 
0.2856 
0 . 1532 
0 . 1000 



Example 6.16 



In order to illustrate the deiivation of a lattice structure for an all-pole (AR model) 
filter, we select a transfer function 



1 



1 - 0.2051Z-1 - 0.0504Z-2 + 0.0154z-3 



(6.66) 



and use the MATLAB function [k] = tf 2latc ( i , den) to get the vector output 
for the lattice coefficients as shown below: 



k = -0.2145 
-0.0473 
0.0154 
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The lattice structure for this filter is shown in Figure 6.19b, where H{z ) = 

Y(z)/Xiz). 

Suppose that we select an allpass transfer function H^piz^^) 

1 0-0154 - 0.0504Z-1 - 0.0205z-^ + z'^ 
WapU ) - ^ _ 0 2051Z-1 - 0.0504Z-2 + 0.0154z-3 ^^'^'^ 

and use the function [k,v]= tf2 late (num, den) we get the following outputs 
for the vectors k and v: 

k = -0.2145 

-0.0473 
0.0154 
V = 0.0000 

0.0000 

0.0000 

1.0000 

Although this allpass transfer function has a numerator and a denominator and 
hence is not an AR model, the lattice structure for realizing it is the same as the 
lattice structure for an AR model in Figure 6.19b, but the output is V(z) and not 
Y(z). Hence the allpass transfer function realized is Hap(z^') = V(z)/X(z). 

When we compare Figure 6.17 for the lattice structure for the third-order 
FIR (MA) filter and Figure 6.19b for the lattice structure for the third-order 
IIR all-pole (AR) or the allpass (AP) filter, carefully note the direction of the 
multipliers and their signs, which are different. Also note that the output terminals 
are different for the all-pole filter and allpass filters in Figure 6.19b. 



6.5.1 MATLAB Program Used to Find Allpass Filters in Parallel 

A MATLAB program lp2apx.m, developed by the author, to obtain the decom- 
position of a lowpass filter as the sum of two allpass filters is given below. 
The input data consist of the cutoff frequency Wp of the passband, the stopband 
frequency Wj, the maximum attenuation Ap in the passband, and the minimum 
attenuation A, in the stopband, which are entered according to the choice of 
the Butterworth, Chebyshev I, Chebyshev II, and elliptic lowpass filters. If the 
order of the filter derived from the functions buttord, chebiord, cheb2ord 
or ellipord is found to be an even integer, it is automatically increased by 
one to make it an odd-order integer. The program immediately makes avail- 
able the magnitude response of the specified lowpass filter G(z), the response 
of the lowpass filter computed from the two allpass filters Ai(z) and ^2(2), and 
also the highpass filter H(z)- The coefficients of the numerator and denomina- 
tor polynomials of Ai(z) and A2(z) are obtained by typing ain, aid, A2N, and 



REALIZATION OF FIR AND MR FILTERS USING MATLAB 



335 



A2D, respectively. So also the coefficients of the numerator and denominator of 
G(z) can be obtained by typing b and a, respectively. If we type ai , A2 , g, 
or H, the program displays the transfer function as the ratio of two polynomi- 
als. The program may not work successfully if the specifications call for a very 
narrow transition band or a very high order for the filter, because of numerical 
inaccuracy. 

%This Matlab Program lp2apx.m obtains the allpass filters 
% Ai(z) and A2(z) from the lowpass (Butterworth, Chebyshev I 
% and Elliptic) filters of odd order, 
clear all 

Wp= input (' Enter the passband cutoff frequency between 0 
and 1 ' ) ; 

Ws=input (' Enter the stopband cutoff frequency Wp<Ws<l'); 
Ap= input (' Enter the max . attenuation in the passband'); 
As= input (' Enter the min . attenuation in the stopband'); 
disp('As f type, type in (1) for Butterworth, (2) for 

Chebyshev I, (3) Chebyshev II and (4) for Elliptic 

filters' ) ; 
ftype= input ( ' ' ) ; 
if ftype==l 

disp (' Butterworth Lowpass Filter'); 

[N,Wn] =buttord{Wp,Ws,Ap,As) ; 
M=mod(N,2) ; 
if M==0 
N=N+1 
end 

[b , a] =butter (N, Wn) ; 
end 

if ftype==2 

disp (' Chebyshev I Lowpass Filter') 
[N,Wn] =cheblord(Wp,Ws,Ap,As) ; 
M=mod(N,2) ; 
if M==0 
N=N+1 

end 

[b,a] =chebyl (N,Ap,Wn) ; 
end 

if ftype==3 

disp (' Chebyshev II Lowpass filter') 
[N,Wn] =cheb2ord(Wp,Ws,Ap,As) ; 
M=mod(N,2) ; 

if M==0 
N=N+1 

end 
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[b,a] =cheby2 (N,As,Wn) ; 
end 

if ftype==4 

disp (' Elliptic Lowpass Filter') 
[N,Wn] =ellipord(Wp,Ws,Ap,As) ; 

M=mod (N, 2) ; 
if M==0 
N=N+1 
end 

[b,a] =ellip (N,Ap,As,Wn) ; 
end 

[hO,w] =freqz (b,a,256) ; 
HO=abs (hO) ; 
plot (w/pi,HO) ;grid 
axis ([0.0 1.0 0.0 1.0]) 

title ( 'MAGNITUDE OF SPECIFIED LP FILTER') 

ylabel ( ' Magnitude ' ) 

xlabel ( ' Normalized frequency' ) 

% TO FIND Q(z) 

k=sum (a) / sum (b) ; 

b=b*k; 

fliped_a= fliplr(a); 

%R(z)= Q2 (z) =P2 (z) -z*-N D(z*-l)D(z) 

R=conv (b, b) -conv (a, f liped^) ; 

% Calculate Q 

Q(1)=R(1)"(0.5) ; 

Q(2) =R(2) / (2*Q(1) ) ; 

for n=2 :N 

term=0 ; 

for k=l:n-l 

term=Q (k+1) *Q (n-k+1) +term; 
end 

Q{n+l)=(R(n+l) -term) / (2*Q (1) ) ; 
end 

%Zeros of P+Q is calculated 

]=i; 

k=0; 

P_plus_Q=b+Q; 

zeros = roots (P_plus_Q) ; 

for i=l:N 

if abs (zeros (i) ) <1 

zero_in ( j ) =zeros (i) ; 

j=j+i; 

else 

k=k+l; 
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zero_out (k) =zeros (i) ; 

end 

end 

AlN=poly { zero_out ) ; %Numerator of A_l (z) 
AlD=f liplr (AIN) ; %Denominator of A_l(z) 
Al=tf (AIN, AID, 1) ; 

A2D=poly ( zero_in) ; %Denominator of A_2 (z) 
A2N=f liplr (A2D) ; %Numerator of A_2 (z) 

A2=tf (A2N,A2D, 1) ; 

G=0 . 5* (A1+A2) ; % LOWPASS FILTER FROM THE TWO ALLPASS FILTERS 

[numlp, denlp] =tfdata (G, ' v' ) ; 

[hi , w] =f reqz (numlp, denlp, 256) ; 
Hl=abs (hi) ; 
figure 

plot (w/pi,Hl) /grid 
axis( [0.0 1.0 0.0 1.0] ) 

title ('MAGNITUDE OF LP FILTER FROM THE TWO ALLPASS FILTERS') 

ylabel ( ' Magnitude ' ) 

xlabel (' Normalized frequency') 

H=0 . 5* (A1-A2) ; % HIGHPASS FILTER FROM THE TWO ALLPASS FILTERS 

[numhp , denhp] =tf data (H, ' v' ) ; 

[h2 , w] =f reqz (numhp, denhp, 2 55) ; 
H2=abs (h2) ; 
figure 

plot (w/pi , H2 ) ; grid 
axis( [0.0 1.0 0.0 1.0] ) 

title ( 'MAGNITUDE OF HP FILTER FROM THE TWO ALL PASS FILTERS') 

ylabel ( ' Magnitude ' ) 

xlabel ( 'Normalized frequency' ) 

%END 

Example 6.17 

We illustrate the use of this program by taking the example of an elliptic lowpass 
filter with the specifications Wp — 0.4, Wg — 0.6, Ap = 0.3, and A, — 35, which 
have been chosen only to highlight the passband and stopband responses. A 
complete session for running this example is given below, including the three 
magnitude response plots mentioned above: 

Enter the passband cutoff frequency between 0 and 1 0.4 
Enter the stopband cutoff frequency Wp<Ws<l 0.6 
Enter the max . attenuation in the passband 0.3 
Enter the min . attenuation in the stopband 3 5 
As ftype, type in (1) for Butterworth, (2) for Chebyshev I, 
(3) for Chebyshev II (4) for Elliptic filters 
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4 

Elliptic Lowpass Filter 

N = 

5 

AIN 

AIN = 

1.0000 -1.3289 1.9650 

AID 

AID = 

1.9650 -1.3289 1.0000 
A2N 

A2N = 

-0.3667 1.1036 -0.9532 1.0000 
A2D 

A2D = 

1.0000 -0.9532 1.1036 -0.3667 
Al 

Transfer function: 
z*2 - 1.329 z + 1.965 

1.965 z^2 - 1.329 z + 1 

Sampling time: 1 

A2 

Transfer function: 

-0.3667 z^3 + 1.104 z^2 - 0.9532 z + 1 
z^3 - 0.9532 z^2 + 1.104 z - 0.3667 
Sampling time: 1 
G 

Transfer function: 

0.1397 z*5 + 0.1869 z^4 + 0.3145 z*3 + 0.3145 z*2 + 0.1869 z 
+ 0.1397 

1.965 z^5 - 3.202 z*4 + 4.435 z*3 - 3.14 z*2 + 1.591 z 
- 0.3667 



Sampling time: 1 
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Transfer function: 

0.8603 z*5 - 2.469 z*4 + 4.021 z*3 
- 0.8603 



4.021 z 2 + 2.469 z 



1.965 z 5 - 
- 0.3667 



3.202 z 4 + 4.435 z 3 



3.14 z 2 



1.591 z 



Sampling time: 1 

We rewrite the transfer function G(z~') in the following form for reference in 
the next chapter: 

0.1397\ (1 + 1.337Z-1 + l.lSlz'^ + l.lSlz'^ + 1.337z-4 + z'^) 
1.965 / (1 - 1.629Z-1 + 2.256Z-2 - 1.597z-3 + 0.8096z-4 - 0.1866^-5) 

(6.68) 

The magnitude response of the lowpass elliptic filter G(z), the magnitude 
response of the parallel connection G{z) — j[Ai{z) + A2{z)], and that of the 
highpass filter H{z) 
6.22, respectively. 

The two allpass filter functions (6.69) and (6.71) obtained in the example 
above are expressed in the form of (6.70) and 6.72, respectively. The function 
Ai(z) can be realized in the direct form, and ^2(2) can be realized in many 
of the structures that we have already discussed, for example, the direct form. 



5[^i(z) — ^2(2)] are shown in Figures 6.20, 6.21, and 



Magnitude of specified LP filter 



1 

0.9 
0.8 
0.7 
0, 0.6 

"O 

1 0.5 

CO 

^ 0.4 

0.3 
0.2 
0.1 
0 











































































































































































1 


















i 




k — 


— 1 




-1 





0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 
Normalized frequency 



Figure 6.20 Magnitude response of the elliptic lowpass filter G(z). 



340 



FILTER REALIZATIONS 



1 

0.9 
0.8 
0.7 
0.6 
0.5 
0.4 
0.3 
0.2 
0.1 
0 



Magnitude of LP filter from the two all pass filters 
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Figure 6.21 Magnitude response of two allpass filters in parallel. 
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Figure 6.22 Magnitude response of a highpass filter from the two allpass filters in 
parallel. 
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Figure 6.23 First-order allpass structures. 
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parallel form, or lattice-ladder form. But the class of allpass functions of first 
and second orders can be realized by many structures that employ the fewest 
multipliers [1]. A few examples of first-order and second-order allpass filters 
are shown in Figures 6.23 and 6.24, respectively. Their transfer functions are 
respectively given by 



Ai(z) 



Aii(z) = 



1 + Jiz-i 

did2 + diz~^ + 
1 + + d\d2Z~^ 



We choose the simpler structure of second-order allpass filter from Figure 6.24a 
for Ai and ^2(2), which requires fewer delay elements than do the remaining four 
second-order structures. When these two allpass filters are connected in parallel 
(as shown in Fig. 6.16), we get the structure shown in Figure 6.25 for the transfer 
function G{z) of the fifth-order elliptic lowpass filter chosen in this example: 



z^- 1.329Z+ 1.965 
1.965z2- 1.329Z+ 1 
1 - 1.329z~' + 1.965z~2 



(6.69) 



1.965 - 
0.5089 



1.329Z-1 +Z-2 
-0.6763Z"' +z" 



1 - 0.6763Z-1 + 0.5089Z- 



(6.70) 
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Figure 6.25 A fifth-order elliptic lowpass IIR filter realized as the parallel connection 
of two allpass structures. 
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-0.3667 + 1.104z^ - 0.9532z + 1 
z3_o.9532z2 + i.io4z- 0.3667 ^ ^ 

_ -0.3667 + 1.104Z-1 - 0.9532Z-2 + z'^ 

~ 1 - 0.9532Z-1 + 1.104Z-2 - 0.3667z-3 ^ ' "* 

We express the third-order allpass function AiCz) in product form as shown 
in (6.73), using a second-order allpass structure from Figure 6.24a connected 
in cascade with a first-order allpass structure from Figure 6.23a to realize the 
third-order allpass filter A2(z). It is then connected in parallel with the second- 
order aUpass filter Ai(z). The structure for the lowpass elliptic filter G(z) = 
^[^iCz) + ^liz)] is shown in Figure 6.25. We obtain 

= / 0.8805 -0.5368z-^ + z-^ \ /-a4165 + z^X 
V 1 - 0.5367Z-1 + 0.8805Z-2 / V 1 - 0.4165z-i / 



Instead of designing the allpass functions found in Figures 6.24 and 6.25, we 
can design them in the form of lattice allpass structures as described earlier. 
The lattice coefficients for the second-order filter A i (z) and the third-order filter 
A2(z) are found by using the MATLAB function [k, v] = tf 21atc (num, den) , 
and after obtaining the lattice structures for them, they are connected in parallel 
as shown in Figure 6.27. 

%Design of the second order filter Ai{z) 
Alnum= [0 . 5089 -0.6763 1] ; 
Alden=[l -0.6763 0.5089]; 
[K1,V1] =tf21atc (Alnum,Alden) 

%Lattice and ladder coefficients for Ai{z) 

Kl = 

-0 .4482 

0.5089 

VI = 

0 

0 

1 



%Design of third order filter A2(z) 
A2num= [-0.3667 1.104 -0.9532 1] ; 
A2den=f liplr (A2num) 
[K2,V2] =tf21atc (A2num,A2den) 
%Lattice and ladder coefficients for A2(z) 



K2 = 
-0.3385 
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0 .8717 
-0.3667 

V2 = 
0 
0 
0 

1 

The circuit realizing the third-order transfer function A2(z) in the form of a 
lattice-ladder structure is shown in Figure 6.26, where the values of Vq — Vi = 
= 0 as shown by the vector V2 above. 

The circuit realizing the fifth-order lowpass elliptic filter as the parallel connec- 
tion of two allpass filters Ai(z) and A2(z), each realized by the lattice structures, 
is shown in Figure 6.27. 

Now let us compare the different circuits that we have designed to realize 
a lowpass fifth-order, IIR filter. All of these circuits have been designed to 
meet the following same specifications — W,, — 0.4, Ws — 0.6, Ap — 0.3, and 
As = 35 — and have been realized by a cascade connection, a parallel con- 
nection, and a lattice-ladder connection as shown in Figures 6.14, 6.15, and 
6.19, respectively. They use more than the minimum number of five multipliers, 
whereas the lattice-coupled allpass filter shown in Figure 6.25 uses five multipli- 
ers — disregarding the multipliers with a gain of —1 or ^ because they represent 




Vv 



Vv 



yvo 



Y{z) 



Figure 6.26 A third-order allpass filter Aiiz) realized as a lattice-ladder structure. 
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Figure 6.27 Two lattice-ladder allpass structures connected in parallel to realize a fifth- 
order lowpass elliptic filter. 



minor operations on binary numbers. The direct-form IIR filter for a fifth-order 
filter would also require more than five multipliers, whereas the filter shown in 
Figure 6.27, which has lattice -ladder, coupled allpass filters, requires 10 mul- 
tipliers. Therefore we conclude that the parallel connection of allpass filters as 
shown in Figure 6.25 requires a minimum number of delay elements and thus 
offers an advantage over the other structures. 

The realization of IIR filters as a parallel connection of allpass filters has 
another advantage, as explained below. It was pointed out that the magnitude 
response of allpass filters does not change when the multiplier constants are 
quantized to finite wordlength. The other advantage is that there are many struc- 
tures for realizing allpass filters that contain a minimum number of multipliers 
(and delay elements). In the method of realizing the lowpass filter by a connec- 
tion of two allpass filters in parallel, we used Property (6.4) in Equation (6.42) 
which is reproduced below: 

|G(e-''")| — 5 |e.'^i('"' + g./''2(")| — ^ |i -|- g./(ei(w)-e2(m))| < i 

This shows that the lowpass filter containing the two allpass structures in parallel 
has a magnitude response equal to or less than unity. The magnitude response 
in Figure 6.28 illustrates this property in the passband and attains the maximum 
value at three frequencies in the passband, which are marked by arrows. As 
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Figure 6.28 Magnified magnitude response of an elliptic lowpass filter. 

long as the allpass filters maintain a constant magnitude at all frequencies and 
remain stable, as their multiplier constants change in wordlength, the magnitude 
response of the lowpass filter cannot exceed this constant at these three frequen- 
cies, where the derivative of the magnitude response is zero. Hence for small 
changes in wordlength (e.g., by 1 or 2 bits), the change in magnitude response 
at these frequencies is almost zero. At other frequencies in the passband, the 
change in magnitude is also expected to be small, if not zero. Simulation of 
their performance with small changes in wordlength has verified that the change 
in their magnitude response is significantly smaller than that displayed by the 
other structures. This shows that the structure of allpass filters in parallel has 
many advantages compared to the other structures that have been proposed for 
realizing IIR filters. In the next chapter, where the effect of finite wordlength is 
studied in greater detail, the structure for allpass filters in parallel will be called 
lattice-coupled allpass structure. But these structures can be used to design only 
lowpass filters (of odd order) whereas the lattice and lattice-ladder structures 
can realize any transfer function in general. 



6.6 SUMMARY 

When we have obtained the transfer functions of FIR and IIR filters that 
approximate a given set of specifications — as explained in the previous two 
chapters — our next step is to choose the best structures that would meet some 
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important criteria before the algorithm in the time domain can be programmed 
or a filter can be designed and built in hardware. It is obvious that the algorithm 
for implementing a filter will depend on the particular structure being considered 
to realize it. Under ideal assumptions that the magnitude of the input signals and 
the values of the multiplier constants are available with infinite precision, any 
one of the several alternative structures will realize the transfer function. But 
when they are expressed with a finite number of bits, their actual performance 
may be quite different, particularly when they are represented by a fixed-point 
binary representation. So it is necessary to investigate in great detail their perfor- 
mance in the time domain and the frequency domain and compare them. Some 
of the performance criteria used for comparison are the effective degradation in 
the frequency response, the stability and potential limit cycles, complexity of 
the algorithm flow control, number of multiplications, and additions per sample 
output. Extensive simulation on a computer is essential to address these issues, 
before we chose a few structures for further investigation. 

In this chapter, we discussed several structures to realize the FIR and IIR filters 
and commented on the effects of finite wordlength. More detailed discussion of 
this criterion and other issues will be included in the next chapter. 



PROBLEMS 

6.1 Draw the direct form and the cascade form of the FIR filter with the 
following transfer function: 

Hiz-^) = 4(1 + 0.6Z-1 - 0.5z-2)(l - 0.25Z-1 + 0.9z~^) 

6.2 Find the polyphase structure for the FIR filter in Problem 6.1 and its 
transpose. 

6.3 Determine the transpose of the direct-form structure realizing the FIR filter 

Hiz'^) =l + z~'^ - 0.5z~^ + 0.022-3 + 0.003z-^ 

6.4 Determine the polyphase structure for the FIR filter given in Problem 6.3. 

6.5 Find the polyphase structure for the FIR filter 

Hiz-^) = 1 + O.Sz"' + OAz~^ - 0.6z~^ + z~^ + l.2z~^ + 0.2z~^ 

6.6 Obtain the transfer functions Hi (z) = Y(z)/X{z) and H2iz) = G{z)/X{z) 
of the lattice circuit shown in Figure 6.29. 

6.7 Draw the direct form and transpose of the circuit shown in Figure 6.29. 

6.8 (a) Derive the transfer function H\ (z) = Y{z)/X{z) of the lattice structure 

shown in Figure 6.30. 
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Figure 6.29 Problem 6.6. 




Figure 6.30 Problem 6.8. 



(b) Derive the transfer function G(z) = G2(z)/Y(z) and show that the 
transfer function H2{z) — G2{z)/X(z) is an allpass function. 

(c) If the transfer function for the lattice structure shown in Figure 6.30 
is Hiiz) = 1/(1 + 1.38z"' + 1.3z"2), what are the values of Ki and 

6.9 Draw the transpose of the lattice structure shown in Figure 6.29. 

6.10 Plot the unit pulse response of the filter shown in Figure 6.31a,b. 

6.11 Derive the transfer function H{z) — Y(z)/X{z) for the structure shown in 
Figure 6.32. 

6.12 Draw the transpose of the structure shown in Figure 6.32. 

6.13 (a) Draw the circuit in a parallel structure, to realize the following transfer 

function H{z~^) and find its inverse z transform h{n): 



(1 - 0.6z-i + 0.25z-2)(l + 0.4z-i) 
(b) Derive the inverse z transform of 

(1 +0.2z)z2 



H{z) = 



(1 -0.6z + 0.25z2)(l +0.4z) 



PROBLEMS 
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6.14 Find the z transform X{z) of [(0.8)" - (0.4)«] u(n). What is the inverse 
z transform of Z(— z)? 

6.15 Draw the digital filter circuit in both cascade and parallel forms to realize 
the following transfer function: 



Hiz) = 



0.44z2 + 0.36z + 0.02 
(z2 + 0.8z + 0.5)(z-0.4) 



6.16 Draw the direct form I, direct form II, cascade and parallel structures for 
the transfer function 



(1 + 0.2z-i)(l + 0.6z-i + 0.2z-2) 



6.17 Draw the transpose of the structures obtained in Problem 6.16. 

6.18 Given a transfer function 



l + O.lz" 



(1 +0.3z-i)(l +0.5Z-1) 



obtain the cascade and parallel structures to realize it. Draw their transpose 
structures also. 

6.19 Draw the direct form II structure for the structure shown in Figure 6.33. 
Find the unit pulse response of this structure for r — 0.6 and 0 — jt/5. 




-r cos 9 



r cos 6 

Figure 6.33 Problem 6.19. 
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6.20 Obtain as many structures as you can to realize the following transfer 
function: 



(z + 0.1) (z + 0.4) (z2 + 0.5z + 0.06) 
6.21 Determine the cascade and parallel structures for the transfer function 

(1 + 0.3Z-1) 



H{z) = 



MATLAB Problems 



(1 - 0.3z-i)(l - O.Se^f z-i)(l - 0.5e--'T2-i) 



6.22 Find the direct-form and cascade structures realizing the FIR filter function 

H{z~^) = 1 + 0.2z"^ + 0.3Z-2 - 0.4z"^ - 0.5z"^ + 0.6z"^ + z"^ 

6.23 Find the direct-form and cascade structures realizing the FIR filters 

Hi{z~^) = 1 - 0.5z-' + 0.3z-2 + O.lz"^ + Qmz"^ - O.OSz"^ 

and 

H2{z~^) = 1.0 + 0.8z"^ + 0.8z"^ + 0.08z"^ + O.Olz""^ 

6.24 Determine the lattice structures to realize the FIR filters in Problem 6.23. 

6.25 Find the direct form I and the cascade structures to realize the following 
HR filters: 

„ ^ ^ 1 - 0.25Z-1 z-i 1 + 0.4Z-1 



1 + 0.9z-i 1 + 0.5z-i 1 + 0.2Z-1 + 0.08Z-2 
„,_K l + 0.1z-'+z-2-0.2z-3 4z-i 



l + z-^+ 0.24Z-2 (1 - 0.8z-i)(l - 0.4z-i) 

6.26 Find the structure in the parallel and cascade connections to realize the 
following filters: 



l-O.Sz-i l-F0.5z-VVl-0.2z-i l+0.2z 



W + 0.9Z-1 +l + 0.5z-ij 

X ( ^ + 2z-^ \ 

+ 0.4Z-1 1 + 0.6Z-1 + 0.6Z-2 ) 
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6.27 Draw the structures in a cascade connection and in a parallel connection 
to realize the following IIR filter: 

, _K 1-0 + 0.01412-1 + 0.0284Z-2 



I - 2.9061Z-1 + 4.2077Z-2 - 3.45412z-3 
+1.6046z-'i - 0.3365z"^ 



6.28 Draw the lattice structures to realize the following all-pole IIR filters. Are 
they stable? 

, 1 



1.0 + 0.3z-i - 0.04Z-2 - 0.13Z-3 - 0.02z-4 



1.0 + 2.3Z-1 + 0.16Z-2 - 0.25Z-3 - 0.26z-4 



, 1 



1.0 + 0.6z-i - 6.01Z-2 - 3.75Z-3 - i.Sz'^ 
6.29 Draw the lattice structure for the following allpass filters: 
, , _K 0.01 -0.75Z-1 



Aiiz-') = 



1 -0.75Z-1 +0.01Z-2 
-0.12 - 0.06Z-' + O.lz-2 + 



1 + O.lz-i - 0.06Z-2 - 0.12Z-3 

6.30 Find the lattice-ladder structure for the following IIR filter: 

^ ^ 1.0+l.lz-i + 0.5z-2 + 0.1z-3 

6.31 Find the lattice-ladder structure for the following IIR filter: 

, ^ 0.01-0.75Z-1 
^ ^ 1 - 0.75Z-1 + O.Olz-2 

6.32 Determine the lattice-ladder structure for the following IIR filter: 

_i _ -0.12-0.06z-^ + 0.1z-^ + z-^ 
'~ 1 + O.lz-i -0.06z-2-0.12z-3 

6.33 Find the lattice-ladder structure for the following IIR filters: 

0.9 + 0.7z-^ - 0.6z~^ 



Hiiz-') = 
Hiiz-') = 
H^iz-') = 



1.0 + z-i + 0.47Z-2 + 0.098Z-3 + O.OOez-^^ 

l.O + Q.Sz-i +0.5;-^ 

1.0 + z-i + 0.47Z-2 + 0.098Z-3 + O.OOez'^ 

1.0 + z-i +z"^ 

1.0 + z-i + 0.52Z-2 + 0.12Z-3 + O.Oiez""* 
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6.34 Design a lowpass Butterworth filter with Wp = 0.3, Ws = 0.6, Ap = 0.25, 
As = 55 in an lattice-coupled allpass structure. Give the magnitude response 
of the Butterworth filter and the lattice-coupled allpass filter on the same plot. 

6.35 Design a Chebyshev lowpass IIR filter with the specifications from Prob- 
lem 6.34 in a lattice-coupled allpass structure. Give the magnitude response 
of the Chebyshev filter and the lattice-coupled allpass filter structure for 
the same filter on the same plot. 

6.36 Design an elliptic lowpass IIR filter Wp = 0.25, W,, = 0.5, Ap = 0.20, 
As = 60, in a lattice-coupled allpass structure. Give the magnitude 
response of the elliptic filter and the lattice-coupled allpass filter for the 
same filter on the same plot. 
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CHAPTER 7 



Quantized Filter Analysis 



7.1 INTRODUCTION 

The analysis and design of discrete-time systems, digital filters, and their realiza- 
tions, computation of DFT-IDFT, and so on discussed in the previous chapters 
of this book were carried out by using mostly the functions in the Signal Pro- 
cessing Toolbox working in the MATLAB environment, and the computations 
were carried out with double precision. This means that all the data representing 
the values of the input signal, coefficients of the filters, or the values of the unit 
impulse response, and so forth were represented with 64 bits; therefore, these 
numbers have a range approximately between 10"^"** and 10^"** and a precision 
of ~2~^^ = 2.22 X 10~^. Obviously this range is so large and the precision with 
which the numbers are expressed is so small that the numbers can be assumed to 
have almost "infinite precision." Once these digital filters and DFT-IDFT have 
been obtained by the procedures described so far, they can be further analyzed 
by mainframe computers, workstations, and PCs under "infinite precision." But 
when the algorithms describing the digital filters and FFT computations have 
to be implemented as hardware in the form of special-purpose microprocessors 
or application-specific integrated circuits (ASICs) or the digital signal processor 
(DSP) chip, many practical considerations and constraints come into play. The 
registers used in these hardware systems, to store the numbers have finite length, 
and the memory capacity required for processing the data is determined by the 
number of bits — also called the wordlength — chosen for storing the data. More 
memory means more power consumption and hence the need to minimize the 
wordlength. In microprocessors and DSP chips and even in workstations and PCs, 
we would like to use registers with as few bits as possible and yet obtain high 
computational speed, low power, and low cost. But such portable devices such as 
cell phones and personal digital assistants (PDAs) have a limited amount of mem- 
ory, containing batteries with low voltage and short duration of power supply. 
These constraints become more severe in other devices such as digital hearing 
aids and biomedical probes embedded in capsules to be swallowed. So there is a 
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great demand for designing digital filters and systems in which they are embed- 
ded, with the lowest possible number of bits to represent the data or to store the 
data in their registers. When the filters are built with registers of finite length and 
the analog-to-digital converters (ADCs) are designed to operate at increasingly 
high sampling rates, thereby reducing the number of bits with which the samples 
of the input signal are represented, the frequency response of the filters and the 
results of DFT-IDFT computations via the FFT are expected to differ from those 
designed with "infinite precision." This process of representing the data with a 
finite number of bits is known as quantization, which occurs at several points 
in the structure chosen to realize the filter or the steps in the FFT computation 
of the DFT-IDFT. As pointed out in the previous chapter, a vast number of 
structures are available to realize a given transfer function, when we assume infi- 
nite precision. But when we design the hardware with registers of finite length to 
implement their corresponding difference equation, the effect of finite wordlength 
is highly dependent on the structure. Therefore we find it necessary to analyze 
this effect for a large number of structures. This analysis is further compounded 
by the fact that quantization can be carried out in several ways and the arithmetic 
operations of addition and multiplication of numbers with finite precision yield 
results that are influenced by the way that these numbers are quantized. 

In this chapter, we discuss a new MATLAB toolbox called FDA Tool avail- 
able' for analyzing and designing the filters with a finite number of bits for the 
wordlength. The different form of representing binary numbers and the results of 
adding and multiplying such numbers will be explained in a later section of this 
chapter. The third factor that influences the deviation of filter performance from 
the ideal case is the choice of FIR or IIR filter. The type of approximation chosen 
for obtaining the desired frequency response is another factor that also influences 
the effect of finite wordlength. We discuss the effects of all these factors in this 
chapter, illustrating their influence by means of a design example. 



7.2 FILTER DESIGN -ANALYSIS TOOL 

An enormous amount of research has been carried out to address these problems, 
but analyzing the effects of quantization on the performance of digital filters 
and systems is not well illustrated by specific examples. Although there is no 
analytical method available at present to design or analyze a filter with finite 
precision, some useful insight can be obtained from the research work, which 
serves as a guidehne in making preliminary decisions on the choice of suitable 
structures and quantization forms. Any student interested in this research work 
should read the material on finite wordlength effects found in other textbooks 
[1,2,4]. In this chapter, we discuss the software for filter design and analysis 
that has been developed by The MathWorks to address the abovementioned 

' MATLAB and its Signal Processing Toolbox are found in computer systems of many schools and 
universities but the FDA Tool may not be available in all of them. 
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problem-^. This FDA Tool finite design-analysis (FDA) tool, found in the Filter 
Design Toolbox, works in conjunction with the Signal Processing (SP) Toolbox. 
Unlike the SP Toolbox, the FDA Tool has been developed by making extensive use 
of the object-oriented programming capability of MATLAB, and the syntax for the 
functions available in the FDA Tool is different from the syntax for the functions 
we find in MATLAB and the SP Toolbox. When we log on to MATLAB and type 
f datool, we get two screens on display. On one screen, we type the f datool 
functions as command lines to design and analyze quantized filters, whereas the 
other screen is a graphical user interface (GUI) to serve the same purpose. The 
GUI window shown in Figure 7.1a displays a dialog box with an immense array 
of design options as explained below. 

First we design a filter with double precision on the GUI window using the 
FDA Tool or on the command window using the Signal Processing Toolbox and 
then import it into the GUI window. In the dialog box for the FDA Tool, we can 
choose the following options under the Filter Type panel: 

1. Lowpass 

2. Highpass 

3. Bandpass 

4. Bandstop 

5. Differentiator. By clicking the arrow on the tab for this feature, we get 
the following additional options. 

6. Hilbert transformer 

7. Multiband 

8. Arbitrary magnitude 

9. Raised cosine 

10. Arbitrary group delay 

11. Half-band lowpass 

12. Half-band highpass 

13. Nyquist 

Below the Filter Type panel is the panel for the design method. When the 
button for IIR filter is clicked, the dropdown Ust gives us the following options 
specifying the type of frequency response: 

• Butterworth 

• Chebyshev I 

• Chebyshev II 

• Elliptic 

• Least-pth norm 

• Constrained least- j[7th norm 

^The author acknowledges that the material on the FDA Tool described in this chapter is based on 
the Help Manual for Filter Design Toolbox found in MATLAB version 6.5. 
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Figure 7.1 Screen capture of f datool window: (a) window for filter design; 
(b) window for quantization analysis. 



the following options are available for the FIR filter: 



• Equiripple 

• Least squares 

• Window 

• Maximally fiat 

• Least- /)th norm 

• Constrained equiripple 
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To the right of the panel for design method is the one for filter order. We can 
either specify the order of the filter or let the program compute the minimum order 
(by use of SP Tool functions chebord, Buttord, etc.). Remember to choose an 
odd order for the lowpass filter when it is to be designed as a parallel connection 
of two allpass filters, if an even number is given as the minimum order. Below 
this panel is the panel for other options, which are available depending on the 
abovementioned inputs. For example, if we choose a FIR filter with the window 
option, this panel displays an option for the windows that we can choose. By 
clicking the button for the windows, we get a dropdown list of more than 10 
windows. To the right of this panel are two panels that we use to specify the 
frequency specifications, that is, to specify the sampling frequency, cutoff fre- 
quencies for the passband and stopband, the magnitude in the passband(s) and 
stopband(s), and so on depending on the type of filter and the design method 
chosen. These can be expressed in hertz, kilohertz, megahertz, gigahertz, or nor- 
malized frequency. The magnitude can be expressed in decibels, with magnitude 
squared or actual magnitude as displayed when we click Analysis in the main 
menu bar and then click the option Frequency Specifications in the drop- 
down list. The frequency specifications are displayed in the Analysis panel, 
which is above the panel for frequency specifications, when we start with the 
filter design. 

The options available under any of these categories are dependent on the 
other options chosen. All the FDA Tool functions, which are also the functions 
of the SP Tool, are called overloaded functions. After all the design options are 
chosen, we click the Design Filter button at the bottom of the dialog box. The 
program designs the filter and displays the magnitude response of the filter in the 
Analysis area. But it is only a default choice, and by cUcking the appropriate 
icons shown above this area, the Analysis area displays one of the following 
features: 

• Magnitude response 

• Phase response 

• Magnitude and phase response 

• Group delay response 

• Impulse response 

• Step response 

• Pole-zero plot 

• Filter coefficients 

This information can also be displayed by clicking the Analysis button in the 
main menu bar, and choosing the information we wish to display in the Anal- 
ysis area. We can also choose some additional information, for example, by 
clicking the Analysis Parameters. At the bottom of this dropdown list is the 
option Full view Analysis. When this is chosen, whatever is displayed in the 
Analysis area is shown in a new panel of larger dimensions with features that 
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are available in a figure displayed under the SP Tool. For example, by clicking the 
Edit button and then selecting either Figure Properties, Axis Properties, 
or Current Object Properties, the Property Editor becomes active and 
properties of these three objects can be modified. 

Finally, we look at the first panel titled Current Filter information. 
This lists the structure, order, and number of sections of the filter that we have 
designed. Below this information, it indicates whether the filter is stable and 
points out whether the source is the designed filter (i.e., reference filter designed 
with double precision) or the quantized filter with a finite wordlength. The default 
structure for the IIR reference filter is a cascade connection of second-order 
sections, and for the FIR filter, it is the direct form. When we have completed 
the design of the reference filter with double precision, we verify whether it 
meets the desired specification, and if we wish, we can convert the structure of 
the reference filter to any one of the other types listed below. We click the Edit 
button on the main menu and then the Convert structure button. A dropdown 
list shows the structures to which we can convert from the default structure or 
the one that we have already converted. 

For nR filters, the structures are 

1. Direct form I 

2. Direct form II 

3. Direct form I transposed 

4. Direct form II transposed 

5. Lattice ARMA 

6. Lattice-coupled allpass 

7. Lattice-coupled allpass — power complementary 

8. State space 

Items 6 and 7 in this list refer to structures of the two allpass networks in 
parallel as described in Chapter 6, with transfer functions G{z) = ^[Ai(z) -|- 
A2(z)] and H(z) = ^[Aiiz) — A2(z)], respectively. The allpass filters Ai{z) and 
A2(z) are realized in the form of lattice allpass structures like the one shown 
in Figure 6.19b. The MA and AR structures are considered special cases of the 
lattice ARMA structure, which are also discussed in Chapter 6. 
For FIR filters, the options for the structures are 

• Direct-form FIR 

• Direct-form FIR transposed 

• Direct-form symmetric FIR 

When we have converted to a new structure, the information that can be 

displayed in the Analysis area, like the coefficients of the filter, changes. We also 
like to point out that any one of the lowpass, highpass, bandpass, and bandstop 
filters that we have designed can be converted to any other type, by clicking 
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the first icon on tiie left-liand bar in the dialog box and adding the frequency 
specifications for the new filter. 

7.3 QUANTIZED FILTER ANALYSIS 

When we have finished the analysis of the reference filter, we can move to 
construct the quantized filter as an object, by clicking the last icon on the bar 
above the Analysis area and the second icon on the left-hand bar, which sets 
the quantization parameters. The panel below the Analysis area now changes 
as shown in Figure 7.1b. We can construct three objects inside the FDA Tool: 
qf ilt, qf ft, and quantizer. Each of them has several properties, and these 
properties have values, which may be strings or numerical values. Currently 
we use the objects qfilt and quantizer to analyze the performance of the 
reference filter when it is quantized. When we click the Turn Quantization 
On button and the Set Quantization Parameters icon, we can choose the 
quantization parameters for the coefficients of the filter. Quantization of the filter 
coefficients alone are sufficient for finding the finite wordlength effect on the 
magnitude response, phase response, and group delay response of the quantized 
filter, which for comparison with the response of the reference filter displayed 
in the Analysis area. Quantization of the other data listed below are necessary 
when we have to filter an input signal: 

• The input signal 

• The output signal 

• The multiplicand: the value of the signal that is multiplied by the multiplier. 

• The product of the multiplicand and the multiplier constant 

• The output signal 

The object quantizer is used to convert each of these data, and this object has 
four properties: Mode , Round Mode , Overflow mode, and Format. In order to 
understand the values of these properties, it is necessary to review and understand 
the binary representation of numbers and the different results of adding them and 
multiplying them. These will be discussed next. 

7.4 BINARY NUMBERS AND ARITHMETIC 

Numbers representing the values of the signal, the coefficients of both the filter 

and the difference equation or the recursive algorithm and other properties cor- 
responding to the structure for the filter are represented in binary form. They are 
based on the radix of 2 and therefore consist of only two binary digits, 0 and 1, 
which are more commonly known as bits, just as the decimal numbers based on a 
radix of 10 have 10 decimal numbers from 0 to 9. Placement of the bits in a string 
determines the binary number as illustrated by the example = 1001^1010, 
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which is equivalent to xio = 1 x 2^ + 1 x 2^ + 2"' + 2"^ = 9.625. In this dis- 
cussion of binary number representation, we have used the symbol A to separate 
the integer part and the fractional part and the subscripts 2 and 10 to denote the 
binary number and the decimal number. Another example given by 

X2 = b2biboAb-il>-2b-3b-4 (7.1) 

has a decimal value computed as 

xio = bl + b{+b^o + bZ\ + bzl + bzl + bt4 (7.2) 

where the bits b2, bi,bQ, b-\,b-2, b-2,b-4 are either 1 or 0. In general, when 
X2 is represented as 

X2 = bi-ibi-2 ■ • ■ biboAb-ib^2 • • • b-p (7.3) 
the decimal number has a value given by 

7-1 

xw = X! ^^2' (7.4) 

In the binary representation (7.3), the integer part contains / bits and the bit bi-\ 
at the leftmost position is called the most significant bit (MSB); the fractional 
part contains F bits, and the bit b-p at the rightmost position is called the least 
significant bit (LSB). This can only represent the magnitude of positive numbers 
and is known as the unsigned fixed-point binary number. In order to represent 
positive as well as negative numbers, one more bit called the sign bit is added to 
the left of the MSB. The sign bit, represented by the symbol 5 in (7.5), assigns 
a negative sign when this bit is 1 and a positive sign when it is 0. So it becomes 
a signed magnitude fixed-point binary number. Therefore a signed magnitude 
number X2 = 11001a 1010 is xio = —9.625. In general, the signed magnitude 
fixed-point number is given by 

7-1 

^10 = (-1)-^ Yl ^'2' (7.5) 

!=-F 

and the total number of bits is called the wordlength w = I + I + F. When 
two signed magnitude numbers with widely different values for the integer part 
and/or the fractional part have to be added, it is not easy to program the adders 
in the digital hardware to implement this operation. So it is common practice 
to choose 7 = 0, keeping the sign bit and the bits for the fractional part only 
so that F = w — 1 in the signed magnitude fixed-point representation. But when 
two numbers larger than 0.5 in decimal value are added, their sum is larger 
than 1, and this caimot be represented by the format shown above, where 7 = 0. 
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So two Other form of representing the numbers are more commonly used: the 
one's-complement and two's-complement forms (also termed one-complementary 
and two-complementary forms) for representing the signed magnitude fixed-point 
numbers. In the one's-complement form, the bits of the fractional part are replaced 
by their complement, that is, the ones are replaced by zeros and vice versa. By 
adding a one as the least significant bit to the one's-complement form, we get 
the two's-complement form of binary representation; the sign bit is retained in 
both forms. But it must be observed that when the binary number is positive, the 
signed magnitude form, one's-complement form, and two's-complement form are 
the same. 

Example 7. 1 

Given: X2 = 0^1100 is the 5-bit, signed magnitude fixed-point number equal to 
xio = -1-2-1 -I- = 0.75 and U2 = IaHOO is equal to uio = -0.75. The one's 
complement of V2 = IaHOO is IaOOU, whereas the two's complement of V2 is 
1a0011-Fa 0001 = IaOIOO. 

The values that can be represented by the signed magnitude fixed-point repre- 
sentation range from —2^~^~^ to 2^~''~^ — . In order to increase the range 
of numbers that can be represented, two more formats are available: the floating- 
point and block floating-point representations. The floating-point representation 
of a binary number is of the form 

Xio = (1)^M(2^) (7.6) 

where M is the mantissa, which is usually represented by a signed magnitude, 
fixed-point binary number, and £ is a positive- or negative-valued integer with 
E bits and is called the exponent. To get both positive and negative exponents, 
the bias is provided by an integer, usually the bias is chosen as — 1 = 127 
when the exponent £ is 8 bits or e'" — 1 = 1023 when Z? is 11 bits. Without 
the bias, an 8-bit integer number varies from 0 to 255, but with a bias of 127, 
the exponent varies from —127 to 127. Also the magnitude of the fractional part 
F is limited to 0 < M < 1. In order to increase the range of the mantissa, one 
more bit is added to the most significant bit of F so that it is represented as 
{l.F). Now it is assumed to be normalized, but this bit is not counted in the total 
wordlength. 

The IEEE 754-1985 standard for representing floating-point numbers is the 
most common standard used in DSP processors. It uses a single-precision format 
with 32 bits and a double-precision format with 64 bits. 
The single-precision floating point number is given by 

Zio = (-1)'(1.F)2^-12^ (7.7) 

According to this standard, the (32-bit) single-precision, floating-point number 
uses one sign bit, 8 bits for the exponent, and 23 bits for the fractional part 
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Figure 7.2 IEEE format of bits for the 32- and 64-bit floating-point numbers. 



F (and one bit to normalize it). A representation of this format is shown in 
Figure 7.2a. But this formula is implemented according to the following rules in 
order to satisfy conditions other than the first one listed below: 

1. When 0 < E < 255, then = (-l)"(l^f")2^-'27 

2. When £ = 0 and M ^ 0, then Zio = (-1)"(0aF)(2-126)_ 

3. When E — 255 and M ^ 0, then X^q is not a number and is denoted as 
NaN. 

4. When E = 255 and M = 0, then Zio = (-l)"oo. 

5. When £ = 0 and M = 0, then Zio = (-1)"(0). 

Here, (1/^F) is the normalized mantissa with one integer bit and 23 fractional bits, 
whereas (0^^') is only the fractional part with 23 bits. Most of the commercial 
DSP chips use this 32-bit, single-precision, floating-point binary representation, 
although 64-bit processors are becoming available. Note that there is no provision 
for storing the binary point (a) in these chips; their registers simply store the bits 
and implement the rules listed above. The binary point is used only as a notation 
for our discussion of the binary number representation and is not counted in the 
total number of bits. 

The IEEE 754-1985 standard for the (64-bit), double-precision, floating-point 
number is expressed by 

Zio = (-l)'(l.F)2^-^''2^ (7.8) 

It uses one sign bit, 11 bits for the exponent E, and 52 bits for F (one bit is 
added to normalize it but is not counted). The representation for this format is 
shown in Figure 7.2b. 

Example 7.2 

Consider the 16-bit floating-point number with 8 bits for the unbiased exponent 
and 4 bits for the denormalized fractional part, namely, £ = 8 and F — \. The 
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binary number is represented as 

Z2 = 0100000010^0110 

Then the exponent £2 = 100000010; therefore £10 = 130, the denormalized 

mantissa F2 =a 0110, which gives Fio — 0.375. Therefore the normalized man- 
tissa M = 1.375. Finally Xjo = -(1.375)2i30-i27 = +(1.375)23 = 11. 
Consider another example: 

Y2 = 1000001 IIaOI 10 

Then E2 = 00000111, £10 = 7, F2 =a 0110, Fio = 0.375, and finally Fio = 
-(1.375)2^-12'' = (-1.375)2-i20_ 

The dynamic range of floating-point numbers that are supported by the FDA 
Toolbox as well as the SP Toolbox are listed in Table 7.1. 

When the reference filter is quantized, we notice that the default value for the 
quantized data as shown in Figure 7.1b is the 16-bit signed magnitude, fixed- 
point binary number, and this is shown as format [16 15], which means that 15 
bits are used for the fractional part and one bit is used as the sign bit. But note 
that the quantizer for the product and sum has the default format [32 30]. 

In the same panel showing the quantization of the different data, there are two 
other columns listed as Round Mode and Overflow Mode. When we click the 
button for the Round Mode, we get the following options in the dropdown list: 

1. Round: round 

2. Floor: floor 

3. Ceiling: ceil 

4. Fix: fix 

5. Convergent: convergent 

"Rounding" is the operation of choosing the value to the nearest quantized 
number. Negative values that lie halfway between two quantization levels are 

TABLE 7.1 Dynamic Range of Floating Point Numbers Found in FDA Tool 

Type of 



Floating-Point 


Normalized 


Normalized 


Exponent 




Data 


Minimum Value 


Maximum Value 


Bias 


Precision 


Single precision 


2-126 


(2 - 2-23)2127 


127 


2-23 




«1. 18(10-38) 


«(3.4)1038 




«io-^ 


Double precision 


2-1022 


(2 - 2-52)21023 


1023 


2-52 




«2(10-308) 


W(1.7)103''8 




«io-i« 


Custom precision 


2 1— bias 


(2 - 2-'^)2'''''' 


2^-1 - 1 


2-f 
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rounded toward negative infinity, and positive numbers that lie halfway between 
two quantization levels are rounded toward positive infinity. If the number lies 
exactly halfway between two levels, it is rounded toward positive infinity. The 
operation called ' floor' is commonly known as truncation since it discards all 
the bits beyond the b bits, and this results in a number that is nearest to negative 
infinity. These two are the most commonly used operations in binary arithmetic. 
They are illustrated in Figure 7.3, where the dotted line indicates the actual value 
of X and the solid line shows the quantized value xq with b bits. 

The ceiling operation rounds the value to the nearest quantization level 
toward positive infinity, and the fix operation rounds to the nearest level toward 
zero. The convergent operation is the same as rounding except that in the case 
when the number is exactly halfway, it is rounded down if the penultimate bit is 
zero and rounded up if it is one. 

Suppose that two positive numbers or two negative numbers in the fixed-point 
format with b bits are added together. It is possible that the result could exceed 





(b) TRUNCATION (Two's complement) 
-Z-^< (Xq-X) <0 



X 




(c) TRUNCATION (one's complement and 
signed magnitude) 

-Z-" < (Xq - X) < 0, X > 0 
O < (Xq - X) < Z", X < 0 



Figure 7.3 Process of rounding and truncation of binary numbers. 



366 QUANTIZED FILTER ANALYSIS 

the lower or upper limits of the range within which numbers with b bits lie. For 
a signed magnitude, fixed-point number with wordlength w and fraction length 
/, the numbers range from —2^~-^~^ to 2"*^^^' — 2^^, whereas the range for 
floating-point numbers is as given in Table 7.1. When the sum or difference of 
two fixed-point numbers or the product of two floating-point numbers exceeds 
its normal range of values, there is an overflow or underflow of numbers. The 
overflow mode in the FDA panel for the quantized filter gives two choices: to 
use saturate or to wrap. Choosing the saturate mode sets values that fall 
outside the normal range to a value within the maximum or minimum value in 
the range; that is, values greater than the maximum value are set to the maximum 
value, and values less than the minimum value are set to the minimum value in 
the range. This is the default choice for the overflow mode. 

There is a third choice: to scale all the data. This choice is made by clicking 
the Optimization button. Then from the dialog box that is displayed, we can 
use additional steps to adjust the quantization parameters, scale the coefficients 
without changing the overall gain of the filter response, and so on. The coefficients 
are scaled appropriately such that there is no overflow or underflow of the data 
at the output of every section in the realization. 

Before we investigate the effects of finite wordlength and the many realization 
structures, by using all the options in the dialog box in the FDA Tool, it is useful 
to know some of the insight gleaned from the vast amount of research on this 
complex subject. It has been found that in general, the IIR filters in the cascade 
connection of second-order sections, each of them realized in direct form II, are 
less sensitive to quantization than are those realized in the single section of direct 
form I and direct form IT. The lattice ARMA structure and the special case of 
the AR structure are less sensitive to quantization than is the default structure 
described above. The lattice-coupled allpass structure, also known as "two allpass 
structures in parallel," is less sensitive than the lattice ARMA structure. We will 
determine whether realizing the two allpass filters Ai(z) and ^2(2) by lattice 
allpass structures has any advantages of further reduction in the quantization 
effects. If the specified frequency response can be realized by an FIR filter, 
then the direct-form or the lattice MA structure realizing it may be preferable to 
the structures described above, because the software development and hardware 
design of the FIR filter is simpler, is always stable, has linear phase, and is free 
from limit cycles. 

We first design the reference filter that meets the desired specifications; then 
we try different structures for the quantized filter with different levels and types of 
quantization. Comparing the frequency response, phase response, and group delay 
response of the reference filter with those of the quantized filter, we find out which 
structure has the lowest deviation from the frequency response, phase response, 
and so on of the reference filter, with the lowest finite wordlength. The FDA Tool 
offers us powerful assistance in trying a large number of options available for the 
type of filter, design method, frequency specification, quantization of the several 
coefficients, and other variables, and comparing the results for the reference filter 
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and the quantized filter, it allows us to make a suboptimal choice of the filter. 
This is illustrated by the following example. 



7.5 QUANTIZATION ANALYSIS OF MR FILTERS 



Let us select the same fifth-order IIR lowpass elliptic filter that was considered 
in Example 6.17. Its transfer function G(z) is given by 



G{z) = 



0.1397 
1.965 



(1 + 1.337Z-1 + 2.251z-^ + l.lSlz-^ + 1.337z-^ + z'^) 
^ (1 - 1.629Z-1 + 2.256Z-2 - \.591z-^ + 0.8096z-'* - 0.1866z-5) 

(7.9) 

The frequency specifications for the filter are given as cop = 0.4, = 0.6, 
Ap = 0.3 dB, and As = 35 dB. The transfer function G(z) was decomposed as 
the sum of two allpass filters Ai(z) and A2(z) such that G(z) = |[Ai(z) + A2(z)], 
where 



Ai(z) = 



0.5089 - 0.6763z"i + z'^ 
1 - 0.6763Z-1 + 0.5089Z-2 



and 



Aiiz) = 



0.8805 



0.5368Z-1 + z-2 



-0.4165 + Z-' 
1 - 0.5367Z-1 + 0.8805Z-2 J \ 1 - 0.4165z-i 



(7.10) 



(7.11) 



Recollect the following lattice coefficients used to realize the lattice structures 
for Ai(z) and A2(z) computed in Chapter 6: 
For Ai(z): 



Kl 



V : = 



-0.4482 
0.5089 



For A2(z): 



K2 = 



V2 



-0.2855 
0.8805 

0' 
0 
1 
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k3 = [-0.4165] 



Now we log on to the FDA Toolbox by typing f datool in the MATLAB com- 
mand window and enter the following specifications to design the reference filter 
under infinite precision. This is a lowpass, IIR, elliptic filter with sampling 
frequency = 48,000 Hz, fpass = 9600 Hz, F^top = 14,400 Hz, which correspond 
to the normalized sampling frequency — 2, F^^ss — 0.4, Fstop = 0.6, respectively. 
The maximum passband attenuation is set as Ap — 0.3 dB and the minimum stop- 
band attenuation, as Aj = 35 dB. When we design this filter, we find that the 
minimum order of the filter is given as 4, and therefore we increase it to 5 as 
the order of the filter so that we can realize the allpass networks in parallel and 
compare it with the frequency response of other types of filters. With this selec- 
tion, the frequency response and phase response displayed in the Analysis area 
are as shown in Figure 7.4. The coefficients of the numerator and denominator 
of the IIR reference filter are given below. 

Numerator coefficients (normalized to render the constant coefficient of the 
numerator as one) of this reference filter are 

1.000000000000 
1.337660698390 
2.251235030190 
2.251235030190 



Magnitude and phase responses 



0.8 



o 0.6 

3 



: 0.4 



Filter #1: Magnitude 
Filter #1: Phase 



0.2 



Magnitude and Phase Response of Lowpass, Elliptic, IIR 
- Reference Filter of Order 5 




10 15 
Frequency (kHz) 



20 



-80 



■D 



-240 ffl 



-320 



-400 



Figure 7.4 Magnitude response of an IIR elliptic lowpass (reference filter) filter. 
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1.337660698390 
1.000000000000 

The denominator coefficients are 

1.000000000000000 
-1.629530257267632 

2.257141351394922 
-1.598167067780082 

0.809623494277134 
-0.186626971448986 

As expected these results match the coefficients in Equation (7.9) within an accu- 
racy of four digits, because both of the filters were designed by the same Signal 
Processing Toolbox function ellip. 

Next, we turn on the quantization, and click the Set Quantization Param- 
eters button. The quantization parameters are all set to the default values similar 
to those shown in Figure 7.1. We change the format for the fixed-point coeffi- 
cients of the filter from [16 15] to [9 8] without changing the format for any 
of the other data — although most of the DSP chips currently available use 16 or 
32 bits. The magnitude response of the cascade connection of two second-order 
sections and one first-order section in direct form 11 when we quantize the filter 
coefficients to 9 bit wordlength is shown in Figure 7.5, along with the magnitude 



1.4 



Magnitude and phase responses 



1.12 



■ 0.56 



Direct From II, Second Order Sections In cascade 
Format [9 8] for Filter Coefficients 



-80 



-160 S 
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0) 
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Filter #1 : Quantized magnitude 

— Filter #1 : Reference phase 
Filter #1 : Quantized pfiase 
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Figure 7.5 Magnitude response of reference filter and quantized filter with format 
[9 8] in cascade connection of second-order sections. 
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Magnitude response in dB 
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Figure 7.6 Magnified plot of tiie magnitudes (in decibels) of the two filters in Figure 7.5. 

response of the reference filter. The Figure 7.6 shows a magnified plot of the 
magnitude in decibels in the passband, which gives the response of the quantized 
filter, which is very close to the response of the reference filter. But most of 
the DSP chips available on the market have a wordlength that is a power of 2 
(wordlengths of 8, 16, 32, etc.). So we try a quantization of 8 bits, and the mag- 
nitude response of this filter is shown in Figure 7.7. But we see that the deviation 
of the magnitude from that of the reference filter is pronounced near the edge 
of the passband. Although we prefer to choose a wordlength of 8 rather than 9, 
this deviation is considered excessive, so we must choose other structures. As an 
alternative structure, we convert the direct form II structure to the ARMA struc- 
ture with the same wordlength of 8 bits, and the resulting magnitude response is 
shown in Figure 7.8. A magnified plot of this response in its passband is shown 
in Figure 7.9. It does not produce a significant improvement over the response 
shown in Figure 7.7 for the quantized filter in the default structure of direct form 
II, with the same wordlength of 8 bits. 

So we decide to convert the lattice ARMA structure to the lattice-coupled 
allpass structure; each allpass structure is realized by lattice allpass structures and 
starts with a 9-bit fixed-point quantization for the filter coefficients, and we get the 
result shown in Figure 7.10. Hardly any difference is seen between the reference 
filter and the quantized filter with the format [9 8], the same as the direct form 



— Filter #1 : Reference 

— Filter #1 : Quantized 



Magnified plot of Magnitude Response in dB in the passband of 
Direct From II, Second Order sections in cascade 
Format [9 8] for Filter Coefficients 
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Figure 7.7 Magnitude responses of reference filter and quantized filter with format 
[8 7] in cascade connection of second-order sections. 
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Figure 7.8 Magnitude responses of reference filter and quantized filter with format 
[8 7] and lattice ARMA structure. 
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Figure 7.9 Magnified plot of the magnitude responses (in decibels) of reference filter 
and quantized filter with format [8 7] in lattice ARMA structure. 
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Figure 7.10 Magnitude response of a lattice-coupled allpass structure, quantized with a 
format [9 8]. 



QUANTIZATION ANALYSIS OF MR FILTERS 



373 




Magnitude response 



— Filter #1 : Reference 
--- Filter #1: Quantized 



0.8 



■g 0.6 

CO 



0.4 



0.2 



Lattice Coupled Allpass Structure 
Format [7 6] for Filter Coefficients 



10 15 
Frequency (kHz) 



20 



Figure 7.11 Magnitude responses of reference filter and quantized filter with format 
[7 6], in lattice-coupled allpass structure. 



II structure with 9 bits. Next we try the 7 bit wordlength for this structure and 
the magnitude response shown in Figure 7.11. Again, we prefer to choose an 
8 bit wordlength for this structure. The magnitude and phase responses of the 
filter with 8 bits are shown in Figure 7.12. A magnified plot of the magnitude 
in decibels in the passband of this 8-bit filter is shown in Figure 7.13. It shows 
that the maximum attenuation for the reference filter is 0.3 dB as specified, and 
the deviation from the specified passband magnitude, for the quantized filter is 
about 0.1 dB. This amount of deviation is less than that exhibited by the lattice 
ARMA filter in Figure 7.9 Therefore this lattice-coupled allpass structure for the 
IIR filter is chosen as a compromise. 

The lattice coefficients of the second-order allpass filter Ai(z) and those for the 
third-order allpass filter A2(z) realizing the reference filter are printed out and 
shown in the right column of Figure 7.14. The lattice coefficients for the two 
allpass filters displayed in Figure 7. 14 match those given in the vectors Ki , vi , 
K2 , V2 , k3 and V3 given at the beginning of this section, within an accuracy 
of four digits. In the left column are shown the corresponding coefficients of 
the quantized filter with a 8 bit wordlength in the fixed-point, signed magnitude 
format [8 7]. 
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Figure 7.12 Magnitude and pliase responses of reference filter and the quantized filter 
with format [8 7] in lattice-coupled ailpass structure. 
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Figure 7.13 Magnified plot of the magnitude responses (in decibels) of reference filter 
and quantized filter with format [8 7] in lattice-coupled ailpass structure. 
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Quantized Lattice coupled-allpass filter 
Lattlcel 

QuantlzedCoef ficients { 1 ) 

(1) -0.4453125 

(2) 0.5078125 
Lattices 

QuantlzedCoef ficients (2 ) 

(1) -0.3359375 

(2) 0.8750000 

(3) -0.3671875 
beta 

QuantlzedCoef ficients { 3 ) 
t (1) 0.9921875 



ReferenceCoef ficients { 1 ) 
-0.448202538502541490 
0. 508902517834580630 

ReferenceCoef ficients {2 1 
-0.338701369319380500 
0. 871154661800650490 
-0.3 66724 4018 42417720 

ReferenceCoef ficients {3 ) 
1. 000000000000000200 



FilterStructure = latticeca 
ScaleValues = [] 
NumberOf Sections = 1 
StatesPerSection = [5] 
Coef ficientForroat = quantizer (' fixed' , 'round', 'saturate', 
InputForroat = quantizer (' fixed ' , 'floor', "saturate", 
OutputFormat = quantizer (' fixed ' , 'floor', "saturate", 
MultiplicandFormat ~ quantizer (' fixed ' , 'floor', 'saturate', 
ProductFormat = quantizer (' fixed' , 'floor', 'saturate', 
SumFormat = quantizer (' fixed ' , 'floor', 'saturate'. 
Warning; 1 overflow in coefficients. 
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Figure 7.14 Coefficients of reference filter and quantized filter with format [8 
lattice-coupled allpass structure. 



7] in a 



7.6 QUANTIZATION ANALYSIS OF FIR FILTERS 

Next we decide to investigate whether the alternative of designing a quantized 
FIR filter would give us a better result. Choosing the same frequency-domain 
specifications as for the IIR lowpass elliptic filter, we design an FIR lowpass filter 
with an equiripple passband and stopband. The reference filter with infinite 
precision uses the remez algorithm and yields a linear phase FIR (type I) 
filter of order 16. The magnitude response of this filter is shown in Figure 7.15. 
When we select the sign magnitude, fixed-point 7 bit wordlength and the 8 bit 
wordlength, the results are as shown in Figures 7.16 and 7.17, respectively. 

It is apparent that there is not a significant difference between the two filters 
with 7 and 8 bit wordlength. In Figure 7.18 we plot a magnified magnitude 
in decibels in the passband of the FIR filter with 8 bits for the wordlength. The 
maximum deviation from the specified passband ripple of 0.3 dB is ~0.1 dB. The 
coefficients of the reference filter and the quantized filter are listed in Figure 7.19. 
It is noted that several coefficients of the quantized filter have an underflow as 
indicated by the digit 0 in the first column and have been rounded to zero. 

Finally we compare the quantization effects on the IIR with the effect on the 
FIR filter by comparing the magnitude responses shown in Figures 7.18 and 7.13. 
It is easy to notice that the FIR filter has a lower sensitivity to quantization than 
does the IIR filter that we chose above. The IIR filter in the form of the lattice- 
coupled allpass structure and the FIR filter in the direct form have a wordlength 
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Figure 7.15 Magnitude response of a lowpass equiripple FIR (reference filter) filter. 
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Figure 7.16 Magnitude and phase responses of reference FIR filter and quantized filter 
with format [7 6] for filter coefficients. 
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Figure 7.17 Magnitude and phase responses of FIR reference filter and quantized filter 
witli format [8 7] for filter coefficients. 
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Figure 7.18 Magnified magnitude responses (in decibels) of reference FIR filter and 
quantized filter with format [8 7] for the filter coefficients. 
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Figure 7.19 Data for reference FIR filter and quantized FIR filter witti 
length. 



bits of word- 



of 8 bits. The number of multipliers required in FIR direct form is only 9 because 
of the symmetry in its coefficients, whereas the lattice-coupled allpass network 
requires 10 multipliers, which is not a significant difference. However, we know 
that the phase response of the FIR filter is linear, which is a great advantage over 
the IIR filter. Hardware implementation of the FIR filter is simpler than that of 
the IIR filter. Unlike the IIR filter, the FIR filter does not exhibit limit cycles 
and is always stable. This leads to investigate the 8-bit FIR filter further as a 
candidate for generating the code to program a DSP chip of our choice. 

It must be pointed out that the specifications we selected for the digital filter 
may or may not meet typical application requirements. Also, we would like 
to point out that while we argued that a 8 bit wordlength may be preferable 
over a 9 bit wordlength, currently most of the digital signal processors (DSPs) 
are 16-bit or 32-bit devices. The design process using the fdatool is meant 
to illustrate only the different choices and decisions that an engineer may face 
before arriving at a particular digital filter that will be considered for further 
investigation as described below. 

Now we assume that we have designed the digital filter and we have tested 
its performance using the fdatool, when the coefficients of the filter and the 
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input samples are represented by a finite number of bits. We liave also considered 
the effect of rounding or truncating the results of adding signals or multiplying 
the signal value and the coefficient of the filter and ascertained that there is no 
possibility of limit cycles or unstable operation in the filter. Very often a digital 
filter is used as a prominent part of a digital system like a cell phone, which has 
other components besides power supply, keyboard, or other 1/0 interfaces. So 
we have to simulate the performance of the whole system with all components 
connected together in the form of a block diagram. 



7.7 SUMMARY 

In this chapter we described the use of the MATLAB tool, called the fdatool, 
to design digital filters with finite wordlength for the coefficients in fixed-point 
and floating-point representations, and investigated several different types of fil- 
ter structures and different types of magnitude response specifications. Once we 
narrowed down the choice of the filter that meets the frequency response spec- 
ifications, we have to simulate the performance of the filter using Simulink, to 
check that the filter works satisfactorily under different types of input signals 
that will be apphed in practice. In Chapter 8 we discuss this and other practical 
considerations that are necessary for hardware design of the filter or the whole 
digital system in which the filter is embedded. 



PROBLEMS 

The problems given in Chapter 4 can be assigned either as homework or as 

a term project only if the FDA Toolbox is available with MATLAB and Signal 
Processing Toolbox in the computer facilities of the school, college, or university. 
The students may be asked to investigate the quantization effect of the filters 
specified in Chapter 4 and arrive at the suboptimal choice, using these tools. 
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CHAPTER 8 



Hardware Design Using DSP Chips 



8.1 INTRODUCTION 

In Chapter 7, we used the f datool to illustrate the analysis and design of a 
digital filter in which the coefficients of the filter and the input samples are 
represented by a finite number of bits. We also found the effect of rounding or 
truncating the results of adding signals or multiplying the signal value and the 
coefficient of the filter and ascertained that there is no possibility of limit cycles 
or unstable operation in the filter. In the example chosen we decided that an 
FIR filter would meet the frequency response specifications of a lowpass elliptic 
filter, with a wordlength of 8 bits. Very often, however, a digital filter is used 
as a prominent part of a digital system such as a cell phone, which has other 
components such as power supply, keyboard, or other 1/0 interfaces. So we have 
to simulate the performance of the whole system with all components cormected 
together in the form of a block diagram. 

8.2 SIMULINK AND REAL-TIME WORKSHOP 

Simulink is the software that is available as a companion toolbox to MATLAB 
and is used to model and simulate the performance of dynamic systems, under 
varying conditions. Just as MATLAB works with a number of toolboxes, Simulink 
has access to a library of many additional tools called blocksets, such as the 
DSP blockset, fixed-point blockset, communications blockset, and control system 
blockset, as shown on the left side of Figure 8.1. 

The Simulink browser library includes blocksets for simulation of aeronautical 
and mechanical systems, too, namely, are aerospace blockset and simMe- 
chanics.' Each of these blocksets contains a large number of blocks that are used 
to define specific transfer functions or algorithms and a variety of input signals. 

'Depending on the version of Simulink, this may or may not contain some of the blocksets mentioned 
in this chapter. 
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Figure 8.1 Screen capture of the Simulink browser and block diagram of a model. 



The GUI interface is used to drag and drop these blocks from the blockset and 
connect them to describe a block diagram representation of the dynamic system, 
which may be a continuous-time system or a discrete-time system. A mechanical 
system model [6] is shown in Figure 8.1. Simulink is based on object-oriented 
programming, and the blocks are represented as objects with appropriate prop- 
erties, usually specified in a dialog box. Indeed, the fdatool that we used in 
Chapter 7 can be launched from SIMULINK as an object or from the MATLAB 
command window because both of them are integrated together to operate in a 
seamless fashion. Simulink itself can be launched either by typing simulink in 
the MATLAB command window or by clicking the Simulink icon in its toolbar. 

For the simulation of a digital filter, we choose the DSP blockset, which 
contains the following blocks in a tree structure: 

DSP Blockset 



>DSP Sinks 
>DSP Sources 
^■Estimation 

^-Filtering ^Adaptive Filters 

>^Math Functions — >^Filter Design — >^Analog Filter Design 

>^Platform Specific I/O — ^^Multirate filters — >^Digital Filter Design 

^■Quantizers — ^-Digital Filter 

>^Signal Management — ^-Filter Realization 

Wizard 

^•Signal Operations ^Overlap-Add FFT filter 

^■Statistics ->Overlap-Save FFT filter 
>■ Trans forms 
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When we open Simulink window, and click File^New^Model in sequence, 
we get a window for the new model. Then we drag the block shown above 
as Digital Filter Design and drop it in the window for the new model. 
When we click on this object in the new window, it opens the same window 
as the one for the fdatool shown in Figure 7.1. After we have imported the 
parameters of the digital filter that we designed in an earlier session, or after we 
have completed the design of the quantized filter as explained in Chapter 7, we 
use the Filter Realization Wizard shown above under the DSP Blockset 
and get the realization structure for the filter. This serves as the model for the 
filter to which we can now connect different types of sources and observe the 
output on the scope connected to the filter, as the sink. Very often, we are 
required to design a whole system, in which case a digital filter is the only 
major block in the system, but there are other subsystems integrated with it. 
So it may be necessary to use the blocks for the adaptive filters or multirate 
filters or the blocks from the Communication blockset and Controls blockset, 
besides the dsp Blockset, and so on. After building the block diagram model 
for the total digital signal processing system, and using Simulink to carry out 
extensive simulation of the model under varying conditions, we check to ensure 
that it meets the specifications satisfactorily; if not, we may have to modify the 
design of the filter or tune the parameters. For example, we may simulate the 
total system with a finite number of bits in floating-point or fixed-point format, 
using the Fixed Point blockset to represent all data. We may have to change 
the design completely and simulate the new system. 



8.3 DESIGN PRELIMINARIES 

All the design and simulation of digital filters and digital systems done by MAT- 
LAB and Simulink is based on numerical computation of scientific theory. When 
this work is completed, we have to decide on one of the following choices: 

1. Design a VLSI chip, using software such as VHDL, to meet our particular 

design specifications 

2. Select a DSP chip from manufacturers such as Texas Instruments, Analog 
Devices, Lucent, or Motorola and program it to work as a digital system 

3. Choose a general-purpose microprocessor and program it to work as a 
digital signal processor system. 

4. Design the system using the field-programmable gate arrays (FPGAs). 

In all cases, several design considerations have to be explored as thoroughly as 
possible before we embark on the next step in hardware design. 

If we decide to select a DSP chip from one of the abovementioned manufac- 
tures, we have to consider the bandwidth of the signal(s) that the digital filter or 
the the digital system will be processing, based on which sampling frequency of 
the ADC is selected. However, the sampling frequency of the ADC may not be 
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the same as the clock frequency of the CPU in the chip or the rate at which data 
will be transferred from and to the memory by the CPU (central processing unit). 
This in turn determines the rating in mips (millions of instructions per second). 
Depending on the amount of data or memory space required by the processor, the 
amount of power is determined. Other considerations are the I/O (input/output) 
interfaces, additional devices such as the power supply circuit, and the micro- 
controller, add-on memory, and peripheral devices. Finally the most important is 
the the cost per chip. We also need to consider the reliability of the software and 
technical support provided by the manufacturer; credibility and sustainability of 
the manufacturer also become important if the market for the digital filter or the 
system is expected to last for many years. 

The selection of the DSP chip is faciUtated by an evaluation of the chips avail- 
able from the major manufacturers listed above and their detailed specifications. 
For example, the DSP Selection Guide, which can be downloaded from the TI 
(Texas Instruments) Website www.dspvillage.ti.coTn, is an immense source 
of information on all the chips available from them. 

The DSP chips provided by TI are divided into three categories. The fam- 
ily of TMS3206000 DSP platform are designed for systems with very high 
performance, ranging within 1200-5760 mips for fixed-point operation and 
600-1350 mflops (million floating-point operations per second) for floating- 
point operation. The fixed-point DSPs are designated by TMS320C62x and 
TMS320C64X, and the floating-point DSPs belong to the TMS320C67x family. 
The fixed-point TMS32062x DSPs are optimized for multichannel, multifunc- 
tion applications such as wireless base stations, remote-access servers, digital 
subscriber loop (DSL) systems, central office switches, call processing, speech 
recognition, image processing, biometric equipment, industrial scanners, pre- 
cision instruments, and multichannel telephone systems. They use 16 bits for 
multiplication and 32 bits for instructions in single-precision format as well as 
double-precision format. The fixed-point TMS320C64x DSPs offer the high- 
est level of performance at clock rates of up to 720 MHz and 5760 mips, and 
they are best suited for applications in digital communications and video and 
image processing, wireless LAN (local area networking), network cameras, base 
station transceivers, DSL, and pooled modems, and so on. The floating-point 
TMS320C67x DSPs operate at 225 MHz and are used in similar applications. 

The TMS320C5000 DSP family is used in consumer digital equipments, 
namely, products used in the Internet and in consumer electronics. Therefore 
these chips are optimized for power consumption as low as 0.05 mW/mips and 
speeds of <300 MHz and 600 mips; the TMS320C54x DSPs are well known as 
the industry leader in portable devices such as cell phones(2G, 2.5G, and 3G), dig- 
ital audio (MP3) players, digital cameras, personal digital assistants (PDAs), GPS 
receivers, and electronic books. The TMS320C55x DSPs also deliver the highest 
power efficiency and are software-compatible with the TMS320C54x DSPs. 

The TMS320C2000 DSPs are designed for applications in digital con- 
trol industry, including industrial drives, servocontrol, factory automation, 
office equipment, controllers for pumps, fans, HVAC (heating -ventilation -air 
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conditioning), and other home apphances. The TMS320C28x DSPs offer 32-bit, 
fixed-point processing and 150 mips operation, whereas the TMS320C24x DSPs 
offer a maximum of 40 mips operation. 

More detailed information and specifications for the DSPs and other devices 
such as ADCs, and codecs (coders/decoders) supplied by TI can be found in the 
DSP Selection Guide. The amount of information on the software and hardware 
development tools, application notes, and other resource material that is freely 
available in this Website is enormous and indispensable. We must remember that 
DSP chips produced by other manufacturers such as Analog Devices may be 
better suited for specific applications, and they, too, provide a lot of information 
about their chips and the applications. 



8.4 CODE GENERATION 

The next task is to generate a code in machine language that the DSP we have 
selected understands and that implements the algorithm for the digital system 
we have designed. First we have to convert the algorithm for the system under 
development to a code in C/C++ language. This can be done manually by one 
who is experienced in C language programming. Or we simulate the performance 
of the whole system modeled in Simulink, and use a blockset available in it, 
known as the Real-Time Workshop [7] to generate the ANSI Standard C code 
for the model. ^ The C code can be run on PCs, DSPs, and microcontrollers in real 
time and non-real time in a variety of target environments. We connect a rapid 
prototyping target, for example, the xPC Target, to the physical system but use 
the Simulink model as the interface to the physical target. With this setup, we test 
and evaluate the performance of the physical target. When the simulation is found 
to work satisfactorily, the Real-Time Workshop is used to create and download 
an executable code to the target system. Now we can monitor the performance of 
the target system and tune its parameters, if necessary. The Real-Time Workshop 
is useful for validating the basic concept and overall performance of the whole 
system that responds to a program in C code. 

An extension of Real-Time Workshop called the Real-Time Workshop Embed- 
ded Coder is used to generate optimized C code for embedded discrete-time 
systems. 

Note that the C code is portable in the sense that it is independent of any man- 
ufacturer' s DSP chip. But the manufacturers may provide their own software to 
generate the C code also, optimized for their particular DSP chip. However, pro- 
gramming a code in machine language is different for DSP chips from different 
manufacturers, and the different manufacturers provide the tools necessary to 
obtain the machine code from the C code for their DSP chips. 

^Depending on the version of MATLAB/Simulink package installed on the computer in the college 
or university, software such as FDA Tool, Real-Time Workshop and others mentioned in this chapter 
may or may not be available. 
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8.5 CODE COMPOSER STUDIO 

Texas Instruments calls its integrated development tool the Code Composer Stu- 
dio (IDE). The major steps to be carried out are outlined in Figure 8.2. Basically, 
these steps denote the C compiler, assembler, linker, debugger, simulator, and 
emulator functions. It must be pointed out that the other manufacturers also 
design DSP chips for various applications meeting different specifications; their 
own software bundle follows steps similar to those mentioned above for the Code 
Composer Studio (CCS) from Texas Instruments (TI). 

First the Code Composer Studio compiles the CIC++ code to an assembly 
language code in either mnemonic form or algebraic form, for the particular 
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Figure 8.2 Software development flow for generating the object code from the C code. 
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DSP platform that we have chosen. If we choose the TMS320C55x DSPs to 
illustrate the software development cycle, then the command used to invoke the 
C compiler is of the form 

cl55 [-options] [filenames] [-z [link_options] [object_files] ] 

The [filenames] list the C program files, and other assembly language files, and 
even object files with their default extensions . c , . asm, and . ob j , respectively. 
The C language is not very efficient in carrying out a few specific operations, 
such as fixed-point data processing that are used in DSP applications. For this 
reason, assembly language files are added to the C language program files in order 
to improve the efficiency of the program in carrying out time-critical sections 
of the assembly language code delivered by the assembler. We can choose from 
many options in [-options] and in [link_options] to control the way that 
the compiler shell processes the files listed in [filenames] and the way that 
the linker processes the object files. For more details, students should refer to the 
TI simulator user's guide [25]. 

The next step is translation of the assembly language code by the assembler 
to the object code in binary form (or in machine language) specific to the DSP 
platform. The CCS command to invoke the assembler is of the form 

asm55 [input_file [obj ect_f ile] [list_file] [-options]] 

Since there might be several C program files that implement the original algo- 
rithm in small sections, the assembler produces the output file in several sections. 
It may also collect assembly source files from an external library, which imple- 
ment processes that are used again and again at several stages of the software and 
load them into the list of [filenames] . For example, Texas Instruments pro- 
vides a large number of highly optimized functions in three libraries, namely, the 
DSP library (DSPLib), the image processing library (iMAGELib), and the chip 
support library (csLib). Then there are assembly files that are long programs 
and therefore are shortened to a macro so that they can be invoked by a single 
or a few lines of instructions. All of these external files are added to the list 
of assembly language files and converted to binary form, under a single format 
known as the common-object file format (COFF). The object_file produces 
the object file in COFF format; the list_f ile shows the binary object code as 
well as the assembly source code and where the program and the variables are 
allocated in the memory space. But they are allocated in temporary locations, not 
in absolute locations. Therefore these relocatable object files can be archived into 
a library of reusable files that may be used elsewhere. There are many options 
in the assembler, and their use is described in Ref. 25. 

The linker utility is invoked to combine all the object files generated by the 
assembler to one single linked object code, and this is done by assigning absolute 
addresses in the physical memory of the target DSP chip as specified by a memory 
map. The memory map is created by a linker command_xf ile, which lists the 
various sections of the assembly code and specifies the location of the starting 
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address and length of memory space in RAM and ROM (random access and 
read-only memory), and where the individual sections are to be located in the 
RAM and ROM, as well as the various options. Then the linker command is 
invoked as follows: 

lnk55 command_file.cmd 

The linker can call additional object files from an external library and also the 
runtime support (RTS) library files that are necessary during the debugging proce- 
dure. It also has many options that can be used to control the linker output, which 
is an executable COFF object module that has .out as its extension. Detailed 
information on the linker can be found in Ref. 17. Remember that information 
on compiler, assembler, and linker commands may be different for other DSP 
platforms, and information on these commands may be found in TI references 
appropriate for the DSP platform chosen. 

8.6 SIMULATOR AND EMULATOR 

After we have created the executable COFF object module, we have to test and 
debug it by using software simulation and/or by hardware emulation. For low-cost 
simulation, we use the development starter kits, for example, the TMS3205402 
DSP starter kit for the TMS320C54x DSP, and for more detailed evaluation and 
debugging, we use an evaluation board such as the TMS320C5409. Finally, we 
have the emulator boards such as the XDS510 JTAG emulator, which are used 
to run the object code under real-time conditions. 

The executable object code is downloaded to the DSP on the DSK board. 
The simulator program installed on the PC that is connected to the DSK board 
accepts the object code as its input and under the user's control, simulates the 
same actions that would be taken by the DSP device as it executes the object 
code. The user can execute the object code one line at a time, by inserting 
breakpoints at a particular Une of the object program, halt the operation of the 
program; view the contents of the data memory, program memory, auxiliary 
registers, stacks, and so on; display the contents of the registers, for example, 
the input and output of a filtering operation; and change the contents of any 
register if so desired. One can also observe or monitor the registers controlling 
the I/O hardware, serial ports, and other components. If minor changes are made, 
the Code Composer Studio reassembles and links the files quickly to accelerate 
the debugging process; otherwise the entire program has to be reassembled and 
linked before debugging can proceed. When the monitoring and fixing the bug 
at all breakpoints is over, execution of the program is resumed manually. By 
inserting probe points. Code Composer Studio enables us to read the data from 
a file or written to a file on the host PC, halting the execution of the program 
momentarily, and then resume it. It should be obvious that simulation on a DSK 
is a slow process and does not check the performance of the peripheral devices 
that would be connected to the digital system. 
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In order to test the performance of the object code on the DSP in real time, 
we connect an emulator board to the PC by a parallel printer cable, and the 
XDS 510 Emulator conforms to the JTAG scan-based interface standard. The 
peripheral devices are also cormected to the emulator board. A DSP/BIOS II 
plug-in is included in the Code Composer Studio to run the emulation of the 
software. It also contains the RTDX (real-time data exchange) module that allows 
transfer of data between the target DSP and the host PC in real time. The Code 
Composer Studio enables us to test and debug the performance of the software 
under real-time conditions, at full sampling rate. Without disrupting the execution 
of the software, the emulator controls its execution of the breakpoints, single- 
step execution, and monitoring of the memory and registers, and checks the 
performance of the whole system, including the peripheral devices. When the 
emulation of the whole system is found to operate correctly, the software is 
approved for production and marketing. 

This is a very brief outline of the hardware design process, carried out after 
the design of the digital system is completed by use of MATLAB and Simulink. 
Students are advised to refer to the extensive literature available from TI and 
other manufacturers, in order to become proficient in the use of all software 
tools available from them. For example. Analog Devices offers a development 
software called Visual DSP++, which includes a C++ compiler, assembler, linker, 
user interface, and debugging utilities for their ADSP-21xx DSP chips. 

8.6.1 Embedded Target with Real-Time Worl^shop 

Simulink has been expanded to generate and simulate bit-true, timing-accurate 
code for directly designing DSP and FPGA targets and produce tests at system 
level. This software tool considerably reduces the design effort outlined above, 
as it facilitates the design of digital filters and systems obtained by the Signal 
Processing Toolbox and FDA Toolbox and generates executable machine code 
for hardware design. 

8.7 CONCLUSION 

The material presented above is only a very brief outline of the design proce- 
dure that is necessary to generate the assembly language code from the C code, 
generate the object code using the assembler, and link the various sections of 
the object code to obtain the executable object code in machine language. Then 
this code is debugged by using an evaluation board, simulator, and emulator; all 
of these steps are carried out by using an integrated, seamless software such as 
the Code Composer Studio that was used to illustrate the steps. Like any design 
process, this is an iterative procedure that may require that we go back to earlier 
steps to improve or optimize the design, until we are completely satisfied with 
the performance of the whole system in real-time conditions. Then the software 
development is complete and is ready for use in the DSP chips chosen for the 
specific application. 
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MATLAB Primer 



9.1 INTRODUCTION 

MATLAB is a very powerful and well-known software package' that is used 
in science and engineering disciplines, for numerical computation, data analysis, 
and graphical visualization. It is available in almost all platforms such as personal 
computers, and workstations miming under several operating systems. When you 
begin a session by typing the command matlab, the first window displayed on 
the monitor is the command window with the prompt >>, which is waiting for 
your command.^ Use the command exit to end the session. 

MATLAB contains a large collection of built-in functions and commands that 
are used in an interactive mode, when you are in the command window. As soon 
as the name of a function or a command is typed at the prompt in the command 
window, with the proper syntax, the answer is displayed immediately. But there 
are two other windows, the edit window and graphics window, which will be dis- 
cussed later. The software package is designed to use additional sets of functions 
that are more applicable in particular disciplines such as control systems, digital 
signal processing, communications engineering, and image processing. There are 
more than 20 sets known as "toolboxes" (e.g., control toolbox, digital signal pro- 
cessing toolbox, coimnunication toolbox, image processing toolbox). All of them 
run under MATLAB and implement the functions on the basis of matrix manipu- 
lation of numerical data, and that is why the software is called MATLAB (mathx 
laboratory). Simulink is another toolbox that is used to simulate the performance 
of the systems, when the systems are built by connecting individual blocks rep- 
resenting different subsystems and the output is obtained when the systems are 

'The software is available from The MathWorks, Inc., 3 Apple Hill Drive, Natick, MA 
01760-2098, phone 508-647-7000, fax 508-647-7001, email inf o®mathworks . com, Website 
http : / /www . mathworks . com . 

^If you are logging on a workstation connected to a computer network, you may have to set the 
proper environment by typing set env DISPLAY network number: or some other com- 
mand before launching MATLAB. 
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subjected to different kinds of input signals. MATLAB allows us to construct 
new functions using the enormous number of built-in functions, commands, and 
operations in MATLAB and in the many toolboxes, without having to know how 
to compile, link, load, and create executable code, because MATLAB uses its own 
language to carry out all these steps, which are invisible to the user. It carries out 
the steps and gives the answer very fast! In most versions of MATLAB, there is 
a "symbol" toolbox, which performs does symbolic operations such as differen- 
tiation, integration, matrix inversion, and solution of differential equations when 
the operations are expressed in their symbolic form. In more recent versions of 
this software, new toolboxes such as Filter Design Toolbox and DSP Blockset, 
which are based on the object-oriented programming features of MATLAB, have 
been added. These have been treated in some chapters of this book. 

9.1.1 Vectors, Arrays, and Matrices 

Vectors and scalars are special cases of a matrix — all of which are represented 
as arrays in MATLAB. A scalar is an array of 1 x 1 dimension, whereas a row 
vector is an array of 1 x « dimension, and a column vector is an array of « x 1 
dimension. When elements of an array are typed in a row within square brackets, 
with a space between the elements, MATLAB displays it as a row vector. For 
example, when you type 

>>A = [12 0 3 15] 
it displays 

A=l 2 0 3 1 5 

If the array is typed without assigning a name for the array, >>[i 2 o 3 i 5], 
MATLAB responds with 

ans =12 0 3 15 

When you type elements with a semicolon between them, the elements are dis- 
played in a column vector, for example 

>>B=[1 2 0; 3 1 5; 0 4 -2] displays the 3 -by-3 matrix 
B= 1 2 0 

3 15 

0 4-2 

If a semicolumn is entered at the end of an array or a command, then the 
array and the output of the command is not displayed on the command window, 
but the command as well as the output variables are saved in a buffer known 
as the workspace. The workspace saves the variables, data, contents of arrays 
and matrices, and other elements as well as a record of the commands typed 
by the user. It is recommended that at the beginning of the session, you change 



INTRODUCTION 393 



the directory to the disk drive a : if you have one in your computer so that the 
contents of the workspace are saved in the floppy disk in that drive. Instead of 
using the semicolumn between the elements, you can type the element on the 
next line or by leaving one space, type three dots at the end of the line and 
continue on the next line as shown below; this is useful when the array is very 
long and extends beyond the end of the line: 

>>C= [12 0 
3 15 
0 4 -2] 
or 

>>C= [ 1 2 0; 3 1 5; ... 

0 4 -2] 

displays the answer 

C = 1 2 0 
3 15 
0 4-2 

9.1.2 Matrix Operations 

It is now obvious that a column vector can be created by typing the elements 
with a semicolumn separating them or creating a row vector and transposing 
it. In MATLAB, the transpose of a matrix or a vector is carried out by the 
operator, that is, the command x' gives the transpose of the vector or matrix x. 
Since the vectors and matrices listed and described above have been saved in the 
workspace, if we type >>a' , we get 

ans 

1 

2 

0 

3 

1 

5 

and >>D=C' yields 

D = 

13 0 

2 14 
0 5-2 

If we type c ( : ) , we get a column vector with the columns of C arranged in 
a vertical vector: 



ans = 
1 
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3 
0 
2 
1 
4 
0 
5 
-2 

When a scalar, vector, or matrix is multiplied (or divided) by a scalar c, every 
element of the scalar, vector or matrix is multiplied (or divided) by c. When 
c is added to matrix, it is added to every element of the vector or matrix. For 
example, x = 5; f=x*c gives the output 

F= 5 10 0 
15 5 25 
0 20 -10 

FF=x+C gives the output as 
FF= 6 7 5 

8 6 10 

5 9 3 

Addition and subtraction of two matrices (and vectors) is carried out by 
MATLAB, according to the rules of matrix algebra, when they have the same 
dimension. Multiplication of a vector or matrix by a vector or matrix is carried 
out according to the rules of algebra when they are compatible or commensu- 
rate for multiplication. The matrix operations and their corresponding notations 
available in MATLAB are given below: 

Addition + 
Subtraction 

Multiplication * 
Power or exponent 
Transpose 

Left division \ 
Right division / 

Note that the command x=M\b gives us the solution to the equation M*x=b, 
where M is a square matrix that is assumed to be nonsingular. In matrix algebra, 
the solution is given by x = M~^b. The left division is a more commonly used 
operation in application of matrix algebra. (The command for the right division 
x=b/M gives the solution to the equation x*M=b, assuming that x and M are 
compatible for multiplication and the solution in matrix algebra is given by 
x=bM-i.) 
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When we use the same variables used above but define them with new values, 
they become the current values for the variables, so we define and use them 
below as examples of the operations described above: 

>>A= [1 2 1;0 1 1;2 1 1] ; 
>>B= [2 1 0;1 1 1;-1 2 1] ; 
>>C=A+B 

C= 

3 3 1 

12 2 

13 2 
>>D=A*B 
D= 

3 5 3 
0 3 2 

4 5 2 
>>M=A; 

»b= [2, -4, -4] ; 
>>x=M\b 

X = 0.0000 -2.0000 6.0000 

Whereas the addition and subtraction of matrices are carried out by the addition 
and subtraction term by term from the corresponding positions of the elements, 
we know that the multiplication and "division" of matrices follow different rules. 
MATLAB gives the correct answer in all the preceding operations. It has another 
type of operation that is carried out when we use a dot before the sign for the 
mathematical operation between the two matrices. The multiplication ( . * ) , divi- 
sion ( . / ) , and exponentiation ( . ^ ) of the terms in the corresponding positions 
of the two compatible matrices are the three array operations. 

Instead of multiplying the two matrices as d=a*b, now we type a dot before 
the sign for multiplication. For example, the answer to >>d=a. *B is 

D= 

2 2 0 
Oil 
-2 2 1 

It is easy to see the result of the command >>a"^ = A * A as 

ans = 

3 5 4 
2 2 2 

4 6 4 

Let us define a matrix 



X = 



1 
3 



2 
4 
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Now we compute u=x. ^2 and v=2 . *x and get the following outputs: 



>>u=x. 



u 



I' 



3^ 4^ 
>>V=2 . ^X: 



V 



2i 
2^ 



22 
2" 



A matrix can be expanded by adding new matrices and column or row vectors 
as illustrated by the following examples: 



>>F= [A B] 
F= 

12 12 
0 111 
2 11-1 
>>b= [5 4 2] 
>>G= [A;B;b] 
G = 



2 
1 
1 
1 
1 

-1 2 
5 4 



The division operator . / can be used to divide a scalar by each of the matrix 
element as shown below, provided there are no zeros in the matrix: 

>>W = 12. /X produces the result 
W= 12 6 
4 3 

>> WW= [6 2; 2 3] ; 

w . /WW divides the elements of W by the elements of WW term by term: 

ans =2 3 

2 1 

The element in the ( i , j ) position of a matrix G is identified by typ- 
ing >>G(7,2), and we get ans = 4, and we can change its value by typing 
>>G ( 7 , 2 ) =6, so that now we have 
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G = 
12 1 
Oil 
2 11 
2 10 
111 

-1 2 1 
5 6 2 



The colon sign : can be used to extract a submatrix from a matrix as shown by 
the following examples: 



>> Q 



2 5 6 

3 2 4 
-3 1 8 



>>Q ( : , 2 ) gives a submatrix with elements in all rows and the second column only: 

ans = 
5 
2 
1 

The command Q ( 3 , : ) gives the elements in all columns and the third row only: 

ans = 

-3 18 

The command Q ( i : 2 , 2 : 3 ) gives the elements in the rows from 1 to 2 and in 
the columns from 2 to 3: 

ans = 

5 6 
2 4 

There are many other operations that can be applied on a matrix, such as a, 
as listed below: 



MATRIX OPERATIONS 


rot90 (A) 


Rotates the matrix array by 90° 


fliplr (A) 


Flips the columns left to right 


flipud(A) 


Flips the rows up to down 


triu(A) 


Gives the upper triangular part of the matrix 


tril (A) 


Gives the lower triangular part of the matrix 



There are a few special matrices; we will list only three that are often found 
useful in manipulating matrices: 

ones (m, n) , which gives a matrix with the number one in all its m rows and 
n columns 
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zeros (tn, n) , which gives a matrix with zeros in all its m rows and n columns 
eye (m) , which gives the "identity matrix" of order m x m. 

We note that the inverse of a matrix A is obtained from the function inv (A) , 
the determinant of a matrix A is obtained from the function det (A) and the rank 
from rank (A) . 

Since this is only a primer on MATLAB, it does not contain all the information 
on its functions. You should refer to the user's guide that accompanies every 
software program mentioned above or any other books on MATLAB [1-3]. When 
you have logged on to MATLAB or any of the subdirectories for the toolboxes, 
there is an online help readily available. You type help functionname, where 
functionname is the name of the function on which detailed information is 
desired, and immediately that information is displayed on the command window. 
So there is no need to memorize the syntax and various features of the function 
and so on. The best way to learn the use of MATLAB and the toolboxes is to 
try the functions on the computer, using the help utility if necessary. 

9. 1 .3 Scalar Operations 

If r = (0. l;r) radians per second, the MATLAB function sin ( t ) gives the answer 
as 0.3090. To compute and plot v = sin (o . int), in the time interval [0 In] 
we have to choose discrete values for the continuous variable t and compute v 
at these values. To do so, we create an array t=[0.0:0.i:2.o]; this gives the 
sequence of 21 values within t = 0.0-2.0 in increments of 0.1. Now if we type 
the function v=sin {pi*t) , the result is a sequence of 21 values. The command 
stem (v) immediately plots these values for v in a "graphics window" as shown 
in Figure 9.1. 

We have used the command figure to create a new window and the command 
plot (t, v) to get the plot as a continuous plot joining the discrete values of v 
(see Fig. 9.2). If we did not use the conamand figure, the second figure would 
replace the first one on the graphics window. Typing the command grid on the 
conmiand window results in the plots having grid lines shown in these figures. 
Next we use the commands for adding a title and the labels for the y and x 
coordinates with the commands title, ylabel, and xlabel. 

So the commands entered on the command window to get the two figures are as 
follows. Since MATLAB chooses the scales for the x and y coordinates, depend- 
ing on the range of their values, we may have to change the literal arguments in 
the ylabel and xlabel: 

t = [0.0:0.1:2.0] ; 

v=sin (pi*t) ; 
stem(v) ;grid 

title ('Values of sin(pi*t)') 
ylabel (' Values of sin(pi*t)') 
xlabel ( 'Values of lOt') 
figure 
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Figure 9.1 Plot of sin(pi*nT) . 




0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 
Values of 1 0f 

Figure 9.2 Plot of sin(pi*t). 



plot (t , v) /grid 
titleCPlot of sin(pi*t)') 
ylabel (' Value of sin(pi*t)') 
xlabel (' Value of t') 
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9.1.4 Drawing Plots 

Additional arguments can be added in the command plot (t,v) to specify the 
color of the curve; for example, plot (t, v, 'g' ) will show the curve in green 
color. The arguments for other colors are as follows: 

y yellow 
m magenta 
c cyan 
r red 
b blue 
w white 
k black 

The next argument that can be added is a marker used to draw the curve. For 
example, plot (t,v, 'g' , ' + ' ) will plot the curve with the + sign instead of 
the line curve, which is the default marker. Other markers that are available are 

o circle 

point 
* star 

solid line 
: dotted line 

dashed line 

dash-dot-dash 

One can plot several curves in the same figure; for example, we can plot both 
i; and y versus t by the command plot (t,v,'g','-'t,y,'r','*'). Another 
way of plotting more than one variable in the same figure is to use the command 
hold on after plotting the first variable and then typing the command for plotting 
the second variable: 

plot(t,v, 'g' ) ; 

hold on 

plot (t,y, ' r' ) 

The use of the MATLAB commands subplot grid, and axis have been 
described and used earlier in the book. The commands gtext and ginput are 
also very useful in plotting. There is a tool called fvtool (filter visualization 
tool) in the more recent versions of the Signal Processing Toolbox, which offers 
several other features in plotting the response of digital filters. You may type help 
gtext, help ginput, or help fvtool to get more information about them. 

9.1.5 MATLAB Functions 

The other functions, in addition to sin, that are available in MATLAB are given 
below: 
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TRIGONOMETRIC FUNCTIONS 



sin 


sine 


cos 


cosme 


tan 


tangent 


asin 


arcsine 


acos 


arccosine 


atan 


arctangent 


atan2 


four-quadrant arctangent 


sinh 


hyperbolic sine 


cosh 


hyperbolic cosine 


tanh 


hyperbolic tangent 


asinh 


hyperbolic arcsine 


acosh 


hyperbolic arccosine 


atanh 


hyperbolic arctangent 







MATHEMATICAL FUNCTIONS 


abs 


absolute value or magnitude 


angle 


phase angle of a complex number 


sqrt 


square root 


real 


real part of a complex number 


imag 


imaginary part 


conj 


complex conjugate 


round 


round toward nearest integer 


fix 


round toward zero 


floor 


round toward — oo 


ceil 


round toward oo 


sign 


signum function 


rem 


remainder 


exp 


exponential base 2 


log 


natural logarithm 


loglO 


log base 10 



9.1.6 Numerical Format 

We can specify the format in which MATLAB displays numbers. If the num- 
ber is an integer, then by default, it is displayed as an integer. If it is a real 
number, it is displayed with approximately four digits to the right of the dec- 
imal point (e.g., 12.0945), and this is the default format format short. If 
the number has many more significant digits, we specify other formats, tising 
the scientific notation. For example, let the number be 12.094567832155321. 
If we type the MATLAB command format long, this number will be dis- 
played with 16 digits as 12.09456783215532. If we declare the format short 
e, the number will be displayed with five digits and an exponent in the form 
1.2094e-|-01, whereas the command format long e selects 16 digits and an 
exponent: I.209456783215532e-F01. 

Remember that these formats are used for display on the monitor, the result 
of commands, functions, and operations. But the numerical computations that 
implement the functions and scripts are done by MATLAB with a higher degree 
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of precision if and when it is necessary, for example, when we use the functions 
and scripts in the Signal Processing Toolbox. 

9.1.7 Control Flow 

Three functions are used to control the flow of command execution that depend 
on decisionmaking statements. Such functions are found in other programming 
languages and also in MATLAB. They are for loops, if -elseif -end loops 
and while loops, which will be illustrated below. 
The statement 

>> for n=l : 10 
x(n )=n*2+4*n 

end 

produces a vector containing 10 values ofx(n) = + An, for « = 1, 2, 3, . . . , 10. 

One can define an array such as n=3 : -o . 5 : -i . o, in which the increment 
is —0.5 and the result is an array n = [3.0 2.5 2.0 1.5 1.0 0.5 0.0 
-0.5 -1.0]. The default value for the increment is 1. 

To define a two-dimensional array, and a function H(i,j)=o.i^i+o.2^j,we 
use the statements 

for i =1:20; 
for j =1:2 0; 

X(i,j) = 0.1^i+0.2^j 

end 
end 

An example of the use of the if statement is 

>>n=-10 : 10 
if n<0 

x(n) =0; 
elseif 0<n<5; 

x(n)=(0.8) .*n; 

else 

x{n) =0 

end 

Note that an error message will be shown if we use the statement 
x{n) = (o.8)*n without the dot before the exponent. 

The while loop is executed step by step as long as the relation holds true. 
An example of this is 

>>n=l 
while n<8 
x(n)=0.5^n; 
n=n+l 
end 
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If the values of x(n) when n takes the maximum value of 7 is desired, we 
type X after the end statement and get the result 

0.5000 0.2500 0.1250 0.0625 0.0313 0.0156 0.0078 

But this problem is solved more easily by the following two statements to get 

the same values for x(n), n = 1, 2, 3, . . . , 7, but we have to insert a dot before 
the exponent (^) since n is a row vector of seven elements. It is very helpful to 
find the order of a matrix or a vector A by using the statement s= size (A) to 
know when to use the dot for the term-by-term operation — particularly when we 
get an error message about the dimensions of the matrices: 

> >n= 1:7; 

x(n) = (0.5) .*n 

9.1 .8 Edit Window and IVl-f lie 

So far we have introduced a few of the common functions and operations of 
MATLAB that are used in the command window and the graphics window. 
When we are in the command window, we are in an interactive mode, where each 
command is executed immediately after it is typed and the answer is displayed. If 
we wish to make a change in any one of the previous statements or the input data, 
we have to trace it back one line at a time using the f key and edit the line, then 
use the | key to get to the line where we had stopped. If that statement is very 
many lines before the current line or if we want to make major changes in the 
program, or if we wish to find the output of the program for different values for 
the input parameters, this is not a convenient procedure. So we create a program 
or a script by clicking File-Open-New-M-f ile and use a text editor that is 
built-in MATLAB or any other text editor and save it in the current directory 
as a file with a name and an .m extension. We can write this script using the 
MATLAB functions and operations; we can even use other functions or functions 
that we have written. Such a file is called an M-file, and after it is saved, we click 
the command window and type just the name of the M-file without the extension. 
The entire script is executed if there are no bugs in it and the results displayed. If 
there are any error messages, we go back to M-file in the edit window and make 
corrections, save it, get back to the command window, and then type the name 
of the M-file to run it again. Either we enter the values of the input variable(s) 
in the M-file or add the following command in the M-file: 

input ('Type in the input parameters for xyz' ) 

When the script is to be executed, the program displays the statement Type in 

the input parameters for xyz and waits for the input from the keyboard. 
We may have requests for input for several parameters, and when the data for 
all the parameters are entered by us from the keyboard, the program is executed. 
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This is helpful when we wish to find the response (output) of the program with 
different values for the input parameters. 
Similarly, when we add the statement 

dispC Values of the parameter xx' ) 
disp (xx) 

the program displays the values for the parameter after the script has been 
executed, which may not be otherwise displayed as the output from the pro- 
gram. 

When any statement is preceded by the % character, the statement is not exe- 
cuted by the program; it is used only as a comment for information or explanation 
of what the program does. It is a good practice to add a few Unes with this % 
character at the beginning of any script that we write and include the name of 
the file also. 

Example 9. 1 

We click File, Open, New from the menu bar when we are in the command 
window and then choose M-file. An edit window appears next. Now we give an 
example of a M-file that we write using the built-in text editor: 

>>clear %clears all the variables in the Workspace 

%This program we call Ration. m computes the value of a 

% rational function f (x) with a numerator 2x+0.5 and a 

% denominator x^2+0 . lx+0 . 05 and plots it over the interval 

% 0 < x < 1 . 0 . 

>>x=0.0:0.01:1.0; 

>>num=2*x+0 . 5 ; 

>>den=x. ^2+0 . l*x+0 . 05 ; %Note the dot in the first term on 

% the right side expression 

>>val=num . / den ; 

>>plot (x, val) ;grid 

title ('Plot of the function f (x) ' ) 

ylabeK 'Value of f (x) ' ) 

xlabel (' Value of x' ) 

This file is saved with a name Rat ion. m on the current drive, and then we get 
back to the command window, in which we type >>Ration. All the statements 
of the M-file Rati on. m are executed immediately, and the plot is shown in the 
graphics window (see Fig. 9.3). If there are any error messages, we launch the 
file in the edit window, then edit and correct the statements where necessary. 
This example is a simple one, but we have many examples of M-files as weU as 
files used in an interactive mode discussed earUer in the book. 
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9.2 SIGNAL PROCESSING TOOLBOX 

The Signal Processing Toolbox is a collection of about 160 functions that are 
extensively used for the analysis, design, and realization of discrete-time sys- 
tems and tasks or operations such as modeling, detection, filtering, prediction, 
and spectral analysis in digital signal processing. They run under MATLAB, 
which has about 330 functions and operations. By typing help function in 
the command window, where function is the name of these functions, detailed 
information about them is displayed. By typing help signal, we get a com- 
plete list of all the functions in the Signal Processing Toolbox, when this has 
been installed as a subdirectory of the MATLAB directory. If we know the name 
of the function that does the numerical processing but not the syntax and other 
details, we can type help function. But when we have to carry out numerical 
processing but don't know the name of the MATLAB function, we may have to 
go through the list of all MATLAB functions and choose the appropriate one for 
the purpose. The list of all MATLAB functions in the Signal Processing Toolbox 
is given in Section 9.2.1, and students are encouraged to use the help utility and 
become familiar with as many of the functions as possible. That should improve 
their efficiency in calling up the appropriate function immediately when the need 
arises while they write and edit the script. Note that we can use any of the thou- 
sands of functions found in all other toolboxes and in the simulation software 
called Simulink that runs under MATLAB, which makes this software extremely 
powerful and versatile. 
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9.2.1 List of Functions in Signal Processing Toolbox 

>>help signal 

Signal Processing Toolbox 
Version 6.0 (R13) 20-Jun-2002 

Filter analysis. 

abs - Magnitude, 
angle - Phase angle . 

filternorm - Compute the 2-norm or inf-norm of a digital 
filter. 

freqs - Laplace transform frequency response. 

freqspace - Frequency spacing for frequency response. 

freqz - Z-transform frequency response. 

fvtool - Filter Visualization Tool. 

grpdelay - Group delay. 

impz - Discrete impulse response. 

phasez - Digital filter phase response. 

phasedelay - Phase delay of a digital filter. 

unwrap - Unwrap phase . 

zerophase - Zero-phase response of a real filter, 
zplane - Discrete pole- zero plot. 

Filter implementation. 

conv - Convolution. 
conv2 - 2-D convolution, 
convmtx - Convolution matrix, 
deconv - Deconvolution. 

fftfilt - Overlap-add filter implementation, 
filter - Filter implementation. 
filter2 - Two-dimensional digital filtering, 
filtfilt - Zero-phase version of filter, 
filtic - Determine filter initial conditions, 
latcfilt - Lattice filter implementation, 
medfiltl - 1-Dimensional median filtering, 
sgolayfilt - Savitzky-Golay filter implementation, 
sosfilt - Second-order sections (biquad) filter 

implementation . 
upfirdn - Up sample, FIR filter, down sample. 

Discrete-time filter object. 

dfilt - Construct a discrete-time, filter object. 
(Type ''doc df ilt' ' for more information) 
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FIR filter design. 

cremez - Complex and nonlinear phase equiripple FIR filter 
design . 

firl - Window based FIR filter design - low, high, band, 
stop, multi. 

fir2 - FIR arbitrary shape filter design using the frequency 

sampling method, 
fircls - Constrained Least Squares filter design - arbitrary 

response . 

firclsl - Constrained Least Squares FIR filter design - low 

and highpass . 
firgauss - FIR Gaussian digital filter design, 
firls - Optimal least-squares FIR filter design, 
firrcos - Raised cosine FIR filter design, 
intfilt - Interpolation FIR filter design, 
kaiserord - Kaiser window design based filter order 

estimation. 

remez - Optimal Chebyshev-norm FIR filter design, 
remezord - Remez design based filter order estimation, 
sgolay - Savitzky-Golay FIR smoothing filter design. 

IIR digital filter design. 

butter - Butterworth filter design. 

chebyl - Chebyshev Type I filter design (passband ripple) . 
cheby2 - Chebyshev Type II filter design (stopband ripple) . 

ellip - Elliptic filter design. 

maxflat - Generalized Butterworth lowpass filter design, 
yulewalk - Yule-Walker filter design. 

IIR filter order estimation. 

buttord - Butterworth filter order estimation, 
cheblord - Chebyshev Type I filter order estimation. 

cheb2ord - Chebyshev Type II filter order estimation, 
ellipord - Elliptic filter order estimation. 

Analog lowpass filter prototypes. 

besselap - Bessel filter prototype. 

buttap - Butterworth filter prototype. 

cheblap - Chebyshev Type I filter prototype (passband 
ripple) . 

cheb2ap - Chebyshev Type II filter prototype (stopband 
ripple) . 
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ellipap - Elliptic filter prototype. 
Analog filter design. 

besself - Bessel analog filter design, 
butter - Butterworth filter design, 
chebyl - Chebyshev Type I filter design. 
cheby2 - Chebyshev Type II filter design, 
ellip - Elliptic filter design. 

Analog filter transformation. 

Ip2bp - Lowpass to bandpass analog filter transformation. 
Ip2bs - Lowpass to bandstop analog filter transformation 
lp2hp - Lowpass to highpass analog filter transformation. 
Ip21p - Lowpass to lowpass analog filter transformation. 

Filter discretization. 

bilinear - Bilinear transformation with 

prewarping . 
impinvar - Impulse invariance analog to 

Linear system transformations. 

Iatc2tf - Lattice or lattice ladder to transfer function 

conversion . 
polystab - Polynomial stabilization, 
polyscale - Scale roots of polynomial, 
residuez - Z-transform partial fraction expansion. 
sos2ss - Second-order sections to state-space conversion. 
sos2tf - Second-order sections to transfer function 

conversion . 

sos2zp - Second-order sections to zero-pole conversion. 
ss2sos - State-space to second-order sections conversion. 
ss2tf - State-space to transfer function conversion. 
ss2zp - State-space to zero-pole conversion. 
tf21atc - Transfer function to lattice or lattice ladder 
conversion . 

tf2sos - Transfer Function to second-order sections 
conversion . 

tf2ss - Transfer function to state-space conversion. 
tf2zpk - Discrete-time transfer function to zero-pole 
conversion . 

zp2sos - Zero-pole to second-order sections conversion. 
zp2ss - Zero-pole to state-space conversion. 
zp2tf - Zero-pole to transfer function conversion. 



optional 

digital conversion. 
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Windows . 

bartlett - Bartlett window. 

barthannwin - Modified Bartlett-Hanning window, 
blackman - Blackman window. 

blackmanharris - Minimum 4 -term Blackman-Harris window. 

bohmanwin - Bohman window. 

chebwin - Chebyshev window. 

flattopwin - Flat Top window. 

gausswin - Gaussian window. 

hamming - Hamming window. 

hann - Hann window. 

kaiser - Kaiser window. 

nuttallwin - Nuttall defined minimum 4 -term Blackman-Harris 
window . 

parzenwin - Parzen (de la Valle-Poussin) window. 

rectwin - Rectangular window. 

triang - Triangular window. 

tukeywin - Tukey window. 

wvtool - Window Visualization Tool. 

window - Window function gateway. 

Window object. 

sigwin - Construct a window object. 

(Type ''doc sigwin'' for more information) 

Transforms . 

bitrevorder - Permute input into bit-reversed order, 
czt - Chirp-z transform, 
dot - Discrete cosine transform, 
dftmtx - Discrete Fourier transform matrix, 
digitrevorder - Permute input into digit-reversed order, 
fft - Fast Fourier transform. 
fft2 - 2-D fast Fourier transform, 
fftshift - Swap vector halves, 
goertzel - Second-order Goertzel algorithm, 
hilbert - Discrete-time analytic signal via Hilbert 
transform . 

idct - Inverse discrete cosine transform, 
if ft - Inverse fast Fourier transform. 
ifft2 - Inverse 2-D fast Fourier transform. 
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Cepstral analysis. 

cceps - Complex cepstrum. 

icceps - Inverse Complex cepstrum. 

rceps - Real cepstrum and minimum phase reconstruction. 

Statistical signal processing and spectral analysis. 

cohere - Coherence function estimate, 
corrcoef - Correlation coefficients, 
corrmtx - Autocorrelation matrix, 
cov - Covariance matrix, 
csd - Cross Spectral Density. 

pburg - Power Spectral Density estimate via Burg's method, 
pcov - Power Spectral Density estimate via the Covariance 
method . 

peig - Power Spectral Density estimate via the Eigenvector 
method . 

periodogram - Power Spectral Density estimate via the 

periodogram method, 
pmcov - Power Spectral Density estimate via the Modified 

Covariance method, 
pmtm - Power Spectral Density estimate via the Thomson 

multitaper method, 
pmusic - Power Spectral Density estimate via the MUSIC 

method . 

psdplot - Plot Power Spectral Density data, 
pwelch - Power Spectral Density estimate via Welch's 
method . 

pyulear - Power Spectral Density estimate via the 

Yule-Walker AR Method, 
rooteig - Sinusoid frequency and power estimation via the 

eigenvector algorithm, 
rootmusic - Sinusoid frequency and power estimation via 

the MUSIC algorithm, 
tfe - Transfer function estimate, 
xcorr - Cross-correlation function. 
xcorr2 - 2-D cross-correlation, 
xcov - Covariance function. 

Parametric modeling. 

arburg - AR parametric modeling via Burg's method, 
arcov - AR parametric modeling via covariance 
method . 
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armcov - AR parametric modeling via modified covariance 
method . 

aryule - AR parametric modeling via the Yule-Walker method, 
ident - See the System Identification Toolbox, 
invfreqs - Analog filter fit to frequency response, 
invfreqz - Discrete filter fit to frequency response, 
prony - Prony' s discrete filter fit to time response, 
stmcb - Steiglitz-McBride iteration for ARMA modeling. 

Linear Prediction. 

ac2rc - Autocorrelation sequence to reflection coefficients 
conversion . 

ac2poly - Autocorrelation sequence to prediction polynomial 

conversion . 

is2rc - Inverse sine parameters to reflection coefficients 
conversion . 

Iar2rc - Log area ratios to reflection coefficients 

conversion . 
levinson - Levinson-Durbin recursion. 

Ipc - Linear Predictive Coefficients using autocorrelation 
method . 

lsf2poly - Line spectral frequencies to prediction 

polynomial conversion. 
poly2ac - Prediction polynomial to autocorrelation sequence 
conversion . 

poly21sf - Prediction polynomial to line spectral 

frequencies conversion. 
poly2rc - Prediction polynomial to reflection coefficients 

conversion . 

rc2ac - Reflection coefficients to autocorrelation sequence 
conversion . 

rc2is - Reflection coefficients to inverse sine parameters 
conversion . 

rc21ar - Reflection coefficients to log area ratios 

conversion . 

rc2poly - Reflection coefficients to prediction polynomial 
conversion . 

rlevinson - Reverse Levinson-Durbin recursion, 
schurrc - Schur algorithm. 

Multirate signal processing. 

decimate - Resample data at a lower sample rate, 
downsample - Downsample input signal. 
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interp - Resample data at a higher sample rate, 
interpl - General 1-D interpolation. (MATLAB Toolbox) 
resample - Resample sequence with new sampling rate, 
spline - Cubic spline interpolation, 
upfirdn - Up sample, FIR filter, down sample, 
upsample - Upsample input signal . 

Waveform generation. 

chirp - Swept -frequency cosine generator, 
diric - Dirichlet (periodic sine) function, 
gauspuls - Gaussian RF pulse generator, 
gmonopuls - Gaussian monopulse generator, 
pulstran - Pulse train generator. 

rectpuls - Sampled aperiodic rectangle generator. 

sawtooth - Sawtooth function. 

sine - Sine or sin (pi*x) / (pi*x) function 

square - Square wave function. 

tripuls - Sampled aperiodic triangle generator, 
vco - Voltage controlled oscillator. 

Specialized operations. 

buffer - Buffer a signal vector into a matrix of data 
frames . 

cell2sos - Convert cell array to second-order-section 

matrix . 

cplxpair - Order vector into complex conjugate 
pairs . 

demod - Demodulation for communications simulation, 
dpss - Discrete prolate spheroidal sequences 

(Slepian sequences) . 
dpssclear - Remove discrete prolate spheroidal 

sequences from database, 
dpssdir - Discrete prolate spheroidal sequence 

database directory, 
dpssload - Load discrete prolate spheroidal sequences 

from database . 
dpsssave - Save discrete prolate spheroidal sequences 

in database. 

eqtflength - Equalize the length of a discrete-time 

transfer function, 
modulate - Modulation for communications simulation, 
seqperiod - Find minimum- length repeating sequence in a 

vector . 
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sos2cell - Convert second-order-section matrix to cell 
array . 

specgram - Spectrogram, for speech signals, 
stem - Plot discrete data sequence, 
strips - Strip plot. 

udecode - Uniform decoding of the input. 

uencode - Uniform quantization and encoding of the input 
into N-bits. 

Graphical User Interfaces 

fdatool - Filter Design and Analysis Tool, 
fvtool - Filter Visualization Tool, 
sptool - Signal Processing Tool . 
wintool - Window Design and Analysis Tool, 
wvtool - Window Visualization Tool . 

See also sigdemos, audio, and, in the Filter Design Toolbox, filterdesign. 

If we type help functionname, we get information about the syntax and 
use of the function and so on, but if we type type functionname, we get 
the program listing also. An example of this given below; one can modify any 
function, save it with a different name and run it: 

>> type kaiser 

function w = kaiser (n_est , beta) 
%KAISER Kaiser window. 

% W = KAISER (N, BETA) returns the BETA-valued N-point Kaiser 
% window . 

% See also BARTLETT, BARTHANNWIN, BLACKMAN, BLACKMANHARRIS , 
% BOHMANWIN, 

% CHEBWIN, GAUSSWIN, HAMMING, HANN, NUTTALLWIN, RECTWIN, 
% TRIANG, 
% TUKEYWIN, WINDOW. 
% Author(s): L. Shure, 3-4-87 
% Copyright 1988-2002 The MathWorks , Inc. 
% $Revision: 1.15 $ $Date : 2002/03/28 17:28:33 $ 
error (nargchk (2,2, nargin) ) ; 
[nn, w, trivialwin] = check_order (n_est) ; 
if trivialwin, return, end; 
nw = round (nn) ; 
bes = abs (besseli {0,beta) ) ; 
odd = rem (nw, 2 ) ; 
exind = (nw-l)*2; 
n = f ix( (nw+1) /2) ; 
xi = (0:n-l) + .5* (1-odd); 
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xi = 4*xi.*2; 

w = besseli (0,beta*sqrt (1-xi/xind) ) /bes; 
w = abs ( [w(n: -1 :odd+l) w] ) ' ; 
% [EOF] kaiser. tn 
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Active-RC (resistance x capacitance) filters, 
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Adaptive equalization, 2 
Adaptive filters, 24 
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ADPCM coding, 2 
Aerospace electronics, 3 
Aliasing, 117, 220 
AUpass filters 

characteristics of, 230-231 
in parallel, realizations of 
design procedure, 325-326 
lattice-ladder realization, 326-327 
properties of 320-325, 334 
quantized filter analysis, 370, 372-375 
realization using MATLAB, 339-346 
All-pole (AR) filters, realizations, 333-334 
Analog bandpass signal, 120, 126-127 
Analog Devices, 389 
Analog filters, magnitude approximation 
bandpass filter, 187 
bandstop filter, 187 

Butterworth lowpass filters, design theory of, 

194-201 
Butterworth response, 192-194 
Chebyshev I approximation, 202 
Chebyshev I lowpass filters, design theory 
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Chebyshev n approximation, 208-209 
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210-211 

Chebyshev polynomials, properties of, 

202-204 

clliplic function approximation, 212 
highpass filter, 187 
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maximally flat magnitude response, 191-192 
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Analog frequency 

finite impulse response (FIR) filters, 251 



transformations 

bandpass filter, 213-216 

bandstop filter, 216-218 

bilinear transformations, 223 

highpass filter, 212-213 
Analog lowpass filters, 21, 323 
Analog signal processing, 22-25, 177 
Analog signals, discrete-time system, 7 
Analog systems, 7 

Analog-to-digital converter (ADC), 7, 22, 
27-28, 355, 383 

ANSI Standard C code, 385 

Antialiasing filters, 22.119 

Anti-mirror image polynomial, 259 

Antisymmetric coefficient, linear phase FIR 
filters, 254-256, 259 

Application-specific integrated circuits 
(ASICs), 354 

Associative convolution sum, 66 

Attenuation, 194-195, 213, 232-233 

Automotive electronics, 3 

Autoregressive moving-average (ARMA) 
filter realization, 326, 333, 359 
quantized filter analysis, 366, 370-372 

Bandpass (BP) filters 

analog, 187 

digital, 213-216 

discrete-time Fourier transform 
(DTFT), 126 

equiripple FIR filter design, 286, 389 

Hnear phase FIR, 261-263, 270-271 

windowed FIR, 275 
Bandpass signals, sampling, 120-121 
Bandstop (BS) filter 

analog, 187 

digital, 216-218 

frequency-domain analysis, 122, 124, 126 
linear phase FIR, 261-262 
Bandwidth, digital signal processing, 24 
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Bartlett window, finite impulse response (FIR) 

filters, 266, 268-269 
Base station controller (BSC), 25 
Base transceiver stations (BTSs), 25-27 
Bessel function, 268 
Bilinear transformations, infinite impulse 

response (IIR) filters, 221-226 
Binary coding, 6 

Binary numbers, in quantized filter analysis, 

360-367 
Binomial theorem, 203 
Biomedical systems, 2, 354 
Blackman window, finite impulse response 

(Fm) filters, 266, 268 
Bode plot, 149 
Bone scanning, 2 

Bounded-input bounded output (BIBO) 

stability. 77-78 
Butterworth bandpass digital filters, 221, 236 
Butterworth lowpass filters 
design theory of, 194-201 
filter realization 
generally, 323-324 
using MATLAB, 334-337 
Butterworth magnitude response, 192-194 
Butterworth polynomials, 197-198 

C/C++ language, 385-386 

Canonic realization, FIR filters, 309-310 

Cardiac pacemakers, 2 

Cascade realization 

finite impulse response (FIR) filters, 
306-307 

infinite impulse response (IIR) filters, 
313-317, 329-331, 366 
Cauer filter, 212 
Causal sequence, 9, 133 
Causal system, 33 
CeU phones, 354 

Cell repeat pattern, mobile network system, 26 

Charmel coding, 2 

Characteristic roots, 58 

Chebyshev (I/II) approximation, 189, 202, 

208-209, 284 
Chebyshev (I) bandpass filter, 125, 215, 235 
Chebyshev (I/Il) highpass filters, 213, 237-238 
Chebyshev (I/II) lowpass filters 

characterized, 323-324 

design of, 210-211 

design theory of, 204-208 

realization using MATLAB, 334-337 
Chebyshev polynomials, properties of, 
202-204 

Circuit boards, filter design and, 19 



Circuit model, discrete-time system, 71-73 
Closed-form expression, 65, 155 
Code-division multiple access (CDMA) 

technology, 2, 25 
Common-object file format (COFF), 387-388 
Complementary function/complementary 

solution, 58 
Complementary metal oxide semiconductor 

(CMOS) transistors, 19, 23 
Complex conjugate poles, 51-54 
Complex conjugate response, discrete-time 

Fourier transform, 145 
Computed tomography (CT) scarming, 2 
Computer networking technology, 27 
Conjugation property, discrete-time Fourier 

transform, 145 
Consumer electronics, 2 
Continuous-time filters, see Analog filters 
Continuous-time function, 113 
Continuous-time signal, 3-4, 21, 28, 41-42 
Continuous-time systems, 24 
Convolution 
allpass filters, 325 
defined, 25 

discrete-time Fourier series (DTFS), 
164-169 

linear phase finite impulse response (FIR) 
filters, 265 
Convolution sum 

discrete-time Fourier teansform 

(DTFT), 125 
filter reaUzations, 304 
time-domain analysis, 38-41, 82, 94 
z-transform theory, 65-70 
Cooley-Tukey algorithm, 21 
Cos((wo«), properties of, 14-19 
CPU (central processing unit), 384 
Cramer's rule, 62 
Cutoff frequency 

finite impulse response (FIR) filters, 266, 

293-294 
frequency-domain analysis, 141 
infinite impulse response (IIR) filters, 213, 

226-227 
linear phase FIR filters, 272 

Data encryption, 2 

Decryption, 2 

Delay, see also Group delay 

defined, 33 

equalizers, 231, 321 

hardware containing, 68 

z-teansform theory, 46-49 
Demodulation, 25 
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Difference equations, time-domain analysis 

classical method, 59-64 

z-transform theory, 51-56 
Differentiation property, discrete-time Fourier 

transform, 139-142 
Differentiation, z-transform theory, 44-46 
Digital computers, filter design and, 20-21 
Digital filter, see specific types of filters 

characteristics of, generally, 6-7, 219 

designing, 123, 126 
Digital signal, defined, 6 
Digital signal processing 

applications of, 1-3 

system, defined, 23 
Digital signal processors (DSPs) 

defined, 1 

design of, 41, 73 

filter realizations, 303-304, 320 

hardware design, 384-385, 387 

quantized filter analysis, 354, 362, 378 
Digital spectral transformations (DSTs), 
226-230 

Digital subscriber loop (DSL) systems, 384 
Digital-to-analog converter (DAC), 22, 27-28, 
186 

Direct form 11 structure 

finite impulse response (FSR) filters, 

305-306 

infinite impulse response (IIR) filters, 

313-314, 345, 366 
Discrete Fourier transform (DFT) 
characterized, 159-160 
constructed from discrete-time Fourier series 

(DTPS), 160-161 
defined, 112 

finite impulse response (FSR) filters, 

290-292 
MATLAB computations, 172-177 
properties of, 161-170 
Discrete-time Fourier series (DTPS) 
characterized, 156-159 
defined, 112 

properties of, 161-170, 177 
reconstruction from discrete Fourier 
transform, 160-161 
Discrete-time Fourier transform (DTFT) 
characteristics of, 122-125 
defined, 112, 114 
frequency response, 177, 253 
frequency shifting property, 127, 130 
linear phase finite impulse response (FIR) 

filters, 260-261 
MATLAB computations, 147-154 
properties of, 146-147 



time-domain analysis of noncausal inputs, 
125-127 

time reversal property, 128-138, 139 
time-shifting property, 127, 139 
of unit step sequence, 138-147 
Discrete- time function, 122 

Discrete-time sequence, 122 
Discrete-time series synonymously, 122 
Discrete-time signals 
characterized, 3-8 

complex exponential function, 12-14 
constant sequence, 10 
cos(coon), properties of, 14-19 
defined, 4, 32 

frequency-domain analysis, 122 
modeling and properties of, 8-9 

problems, 29-32 

real exponential function, 12 

unit pulse function, 9-10 

unit step function, 10-12 
Discrete-time sinusoidal signal, 132 
Discrete-time system 

defined, 7, 32 

models, 33-36 

performance analysis, 38-39 

structure of, 71 
Distortion, finite impulse response (FIR) 

filters, 250 
Distributive convolution sum, 66 
Dolph-Chebyshev window 

finite impulse response (FIR) filters, 267 

windowed FIR filters, 276 

ECG mapping, 2 
Echo cancellation, 2, 25, 27 
EEC mapping, 2 
Eigenvalues, 58 

Elliptic function approximation, 212 
ElUptic lowpass filters 

characterized, 234, 323-324 

realization using MATLAB, 334-346 
Emulator boards, 388 
Equiripple, generally 

analog frequency transformations, 217 

approximation, 189, 202, 212 

bandpass filter, 235 

design, 280 

finite impulse response (FIR) filters 
design using MATLAB, 285-289 
linear phase, 280-285 

lowpass filter, windowed finite impulse 

response (FIR) filters, 280 
Error detection, 25 

Exponent, quantized filter analysis, 362 
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Exponential functions, discrete-time system 
complex, 12, 14-15 
real, 12 

Fast Fourier transform (FFT) 

computation of, 170-172, 178 

filter realizations, 304 

finite impulse response (FIR) filters, 292 

technique, 21 
FDA Tool finite design-analysis (FDA) tool, 

356-358, 360, 366, 379, 389 
Fetal monitoring, 2 

Field-programmable gate arrays (FPGAs), 

383, 389 
Filter approximation, 19 
Filter design, see specific types of filters 

history of, 19-23 

z-transform theory and, 94 
Filter Design Toolbox, 356 
Filter realizations 

allpass filters in parallel, 320-327, 334-346 

finite impulse response (FIR) filters, 
305-312, 327-329, 334 

infinite impulse response (IIR) filters, 
312-320, 327, 329-334 

using MATLAB, 327-346 

overview of, 303-305 

problems, 347-353 
Final value, z-transform theory, 75-76 
Finite impulse response (FIR) filters 

defined, 37, 250 

equiripple, design using MATLAB, 

285-289 
equiripple linear phase, 280-285 
Fourier series method modified by windows, 

261-273 

frequency-domain analysis, 140, 142, 147, 
151, 153 

frequency sampling method, 289-292 

lattice stiiictures, 309-310 

linear phase, 251-261, 311-312 

overview of, 249-251, 292-294 

problems, 294-301 

quantized filter analysis, 375-379 

realizations 

cascade form, 306-307 

direct form, 305-306 

lattice structures, 309-310 

polyphase form, 307-309 
windowed design using MATLAB, 

273-280 

FIR filters, see Finite impulse response (FIR) 
filters 

First-order polynomials, 315, 327 



Floating-point numbers, quantized filter 

analysis, 362-364, 384 
Folding 

defined, 18 

frequency, 119 
Forced response, 58-61, 64, 94 
Fourier series method, modified by windows 

FIR filter design procedures, 268-273 

Gibbs phenomenon, 263-265 

overview of, 261-263 

window functions, 266-268 
Fourth-order polynomial, 330 
Frequency control, automatic, 25 
Frequency-domain analysis 

DTFS andDFT, 154-170, 177-178 

DTFT and IDTFT, 122-138, 154-170, 
177-178 

fast Fourier transform (FFT), 170-172, 178 
MATLAB computations, 147-154, 172-177, 
184 

overview of, 112, 177-178 
problems, 177-184 
sampling theory, 113-122, 177 
unit step sequence, DTFT of, 138-147 
Frequency sampling, finite impulse response 

(FIR) filters, 289-292 
Frequency shifting property, discrete-time 

Fourier transform (DTFT), 127, 130-131 
functioimame, MATLAB, 93 

Gain control, automatic, 25 
Geophysical data processing, 2 
Gibbs phenomenon, 263-266 
Global positioning system (GPS), 2 
Global System for Mobile Communication 

(GSM), 25 
Graphical user interface (GUI), 356, 382 
Group delay 

analog filters, 188-189 

linear phase finite impulse response (FIR) 
filters, 250, 253, 255-256, 258, 269 

response, frequency-domain analysis, 153 

Hann window, finite impulse response (FIR) 

filters, 266, 268-269 
Haimmng window, finite impulse response 
(FIR) filters 

equiripple design, 287 

implications of, 266, 268 

linear phase filters, 270-271 

windowed filters, 276 
Hardware 

digital filter, 304 

using DSP chips 
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Code Composer Studio, 386-388 
code generation, 385 
design preliminaries, 383-385 
emulator, 388-389 
simulator, 388-389 
Simulink, 381-383 
Harmonics, discrete-time Fourier series, 
156 

Hearing aids, digital, 2, 354 

Hertz per second, 123, 148 

Highpass (HP) filters, linear phase FIR, 

261-262 
Highpass filter 

analog, 187 

digital, 212-213 

finite impulse response (FIR), 293-294 
frequency-domain analysis, 122, 124 
linear phase finite impulse response (FIR), 

261-262 

realization using MATLAB, 339-340 
Hilbert transformer, 285 
Home location register (HLR), 26 

Ideal bandpass filter, frequency-domain 

analysis, 122-125 
IEEE 754-1985 standard, 362-363 
IIR filters, see Infinite impulse response (IIR) 

filters 
Image processing, 2 

Impulse-invariant transformation, 219-221 

Impulse response, 78 

Impulse sampling, 38, 41 

Industrial applications, 3 

Infinite impulse response (IIR) filters 
allpass filters, 230-231 
bilinear transformation, 221-226 
characteristics of, 37, 186-189 
design using MATLAB, 231-238, 240 
digital spectral transformation, 226-230 
frequency-domain analysis, 148, 150-151, 
155 

impulse-invariant transformation, 219-221 

problems, 240-247 
quantized analysis, 367-375 
realizations, 304, 312-320 
Yule-Walker approximation, 238-239 
Initial states, time-domain analysis, 50, 53, 57, 
63 

Initial value, z-transform theory, 74-75 

Input sample response, 67 

Input-output relationship, time-domain analysis 

implications of, 33. 35, 50, 58, 73, 94 

z-transform relationship, 69-71 
Interleaving, 25 



Internet telephony, 1 

Inverse Chebyshev filters, 208 

Inverse discrete Fourier transform (IDFT) 

characterized, 159-160,170-171 

finite impulse response (FIR) filters, 290-291 

MATLAB computations, 172-177 
Inverse discrete-time Fourier series (IDTFS), 
characterized, 157-159, 165, 169, 177 
Inverse discrete-time Fourier transform 
(IDTFT) 

differentiation property, 141-142 

multiplication property, 142-143 

symmetty property, 146 

time-domain analysis of noncausal inputs, 
126 

time reversal property, 129, 131-132, 136, 
141 

Inverse Fourier transform, 1 17 
Inverse z transform 

difference equations, 51, 54, 56, 62 

frequency-domain analysis, 163 

models, 72, 75 

z transform flieory, 41, 49, 92-93 
Iterative optimization, 24, 250 

Jump discontinuity, linear phase FIR filters, 

257-258, 289 
Jury-Marden test, 78-81 

Kaiser window, finite impulse response (FIR) 
filters 

characteristics of, 267-269 
equiripple design, 287 
equiripple linear phase, 28 In 
windowed, 279 

Laplace transform, 42 
Lattice-coupled allpass filter, in filter 
realization 

characteristics of, 322, 346 

power complementary filter, 322 

quantized filter analysis, 370, 372-375 

structures, 320 
Lattice-ladder realization, 326, 332-333 
Lattice-ladder structure, filter realization, 

344-345 
Lattice structure, filter realization 

allpass, 320 

finite impulse response (FIR) filters, 

309-310, 332-334 
infinite impulse response (IIR) filters, 

332-334 

LC (inductance x capacitance) filters, 
19-20, 28 
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Least mean-squares, 263 
Least significant bit (LSB), 361 
Least-squares approximation, 238 
Linear, time-invariant, discrete-time system 

(LTIDT), defined, 249 
Linear and time-invariant (LTI) systems, 33 
Linear convolution sum, 66 
Linearity of system, 50 
Linear phase finite impulse response (FIR) 

filters 

design procedures, 268-273 

overview, 251-256 

properties of, 256-261 

realizations, 311-312 
Linear system, defined, 32 
Local area network (LAN), 384 
Low-pass filters 

analog, 191-192 

characteristics of, 27, 117 

elliptic infinite impulse response (IIR), 
367-375 

equiripple finite impulse response (FIR) 

filter design, 285-286, 288 

quantized analysis, 375-376 
finite impulse response (FIR), 293-294 
frequency-domain analysis, 117, 122-124, 

141-142, 176 
linear phase finite impulse response (FIR), 

261, 264, 270, 272 
windowed finite impulse response (FIR), 

275, 277 

Magnetic resonance imaging (MRI), 2 
Magnitude response 

allpass filters in parallel, 339-340, 345, 
372-374 

discrete Fourier transform (DFT), 175 
discrete-time Fourier transform, 136-137 
elliptic lowpass filter, 339, 346 
equiripple finite impulse response (FIR) filter 

design, 287-288 
finite impulse response (FIR) filters, 270 
frequency-domain analysis, 126, 150, 153 
infinite impulse response (IIR) elliptic 

lowpass filter, 368-372 
linear phase finite impulse response (FIR) 

filters, 256-257, 262-263 
lowpass elliptic filter, 339, 346 
lowpass equiripple finite impulse response 

(FIR) filter, 376-377 
windowed finite impulse response (FIR) 

filter, 277-278 
Magnitude spectrum, 122, 124-125 
Mantissa, quantized filter analysis, 362 



Mathematical functions, MATLAB, 401 

MathWorks, 355 

MATLAB 

allpass filters in parallel determination, 
334-346 

arrays, 392-393 

control flow, 402-403 

defined, 24 

discrete Fourier transform and inverse 
discrete Fourier transform computation, 
172-177 

discrete-time Fourier transform computation, 

147-154 
drawing plots, 400 
edit window, 403 

equiripple finite impulse response (FIR) filter 

design using, 285-289 
FDA Tool, 355, 357, 378-379 
filter realization 

applications, 327-346 

problems, 351-353 
finite impulse response (FIR) filter 

realizations, 327-329, 331-332 
frequency-domain problems, 184 
functions, 400-401 
hardware design, 381-389 
infinite impulse response (IIR) filter 

design, 231-238, 240 

realizations, 327, 329-332 
matrices, 392 

matrix operations, 393-398 

M-window, 403-405 

numerical format, 401 

problems using, 108-110, 184, 247, 

299-301 
scalar operations, 398-399 
Signal Processing Toolbox, 405-414 
vectors, 392 

windowed finite impulse response (FIR) filter 
design using, 273-280 

z-ttansform theory, 81-93 
Matiix algebra, 57-58, 71 
Maximally flat magnitude response, 191-192 
Megahertz, 28 
Military electronics, 2-3 
Minimax approximation, 202 
Minimax design, 280 
Mirror image polynomial, 259 
Mobile phone(s), see Cell phones 

digital signal processing theory, 25 

network, 2, 25-28 
Mobile switching center (MSC), 26 
Modulation, 25 
Monte Carlo analysis, 24 
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Moving average (MA), filter realization, 326, 

332, 334, 359 
Multidimensional filters, 24 
Multipath equalization, 25, 27 
Multiple poles, 55-56 
Multiplication property, discrete-time Fourier 

transform, 142-145 
Multiplier, 33, 68 
Multirate filters, 24 

Natural response, 58-59, 61, 63-64, 94 
Noise cancellation, 25 

Nonrecursive filter, see Finite impulse response 

(FIR) filters 
Normalized digital frequency, 251,257 
Nyquist frequency, 120, 122-123, 257, 276 

One-complementary form, quantized filter 

analysis, 362 
Operational amplifiers, 19, 23 
Oscillation, discrete-time system, 16-17 
Output noise, finite impulse response (FIR) 

filters, 250 
Overflow mode, 366 
Overlap-add method, 68n, 172 
Overlap-save method, 68n, 172 
Overloaded functions, 358 

Parallel forms, infinite impulse response (IIR) 

filter realization, 317-320 
Parks-McClcllan algorithm, 284 
Passband filter, 192 

Passband filter, finite impulse response (FIR): 

characteristics of, 293-294 

equiripple design, 285 

linear, 261 

windowed, 275 
Patient monitoring, 2 
Personal digital assistants (PDAs), 354 
Phase angle, linear phase finite impulse 

response (FIR) filters, 253-255 
Phase response 

frequency-domain analysis, 136-137, 153 

finite impulse response (FIR) filter, 376-377 

infinite impulse response (IIR) filter, 
368-369 

lattice-coupled allpass filter, 374 
Picket fence effect, 172-173 
Polyphase form, finite impulse response (FIR) 

filter realization, 307-31 1 
Positron emission tomography (PET) 

scanning, 2 
Power control, automatic, 25 
Power series, 67 



Preconditioning filter, 22 
Programmable filters, 24 
Public switched telephone network (PSTN), 26 

Quantization, defined, 6 

Quantized filter analysis 

binary numbers and arithmetic, 360-367 
filter design-analysis tool, 355-360 
finite impulse response (FIR) filters, 375-379 
infinite impulse response (IIR) filters, 

367-375 
problems, 379 
software, 354-355 

Radar processing, 2 
Radians per second, 123, 188, 190 
Random access memory (RAM), 388 
Read-only memory (ROM), 388 
Real-time data exchange (RTDX), 389 
Real-Time Workshop 
Embedded Coder, 385 
Simulink, 381-389 
Reconstruction formula, 118 
Rectangular pulse function, discrete-time 

Fourier transform, 140 
Rectangular window, finite impulse response 

(FIR) filters, 264-265, 268 
Recursive algorithm, 36-38, 82, 85, 92, 94, 

304, 325 
Reflection coefficients, 327, 332 
Region of convergence (ROC), 43-44 
remez exchange algorithm, 284, 288-289 
Remote sensing, 2 
r" , z-transform theory, 76-77 
Rounding, in quantized filter analysis, 

364-365 
Routh-Hurwitz test, 79 
Runtime support (RTS), 388 

Sampled-data signals, 4-5 
Sampling frequency, 27-28 
Sampling period, 4 

Sampling theory, frequency-domain analysis 
bandpass signals, 120-121 
continuous-time function, 113, 118 
discrete-time Fourier transform (DTFT), 

114-116 
inverse Fourier transform, 117 
Shannon's sampling theorem, 118-120 
unit impulse response, 113-114, 117-118 

Scalar, defined, 392 

Second-order polynomials, 315, 327 

Seismic data processing, 2 

Shannon's reconstruction formula, 160-161 
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Shannon's sampling theorem, 21, 118-120, 
177 

Shift-invariant system, 32, 51, 53 
Signal Processing (SP) Toolbox, 356, 

358-359, 364, 369, 389, 405-414 
Sign bit, quantized filter analysis, 361-362 
Signed magnitude fixed-point binary number 

representation, 6 
Simulink, 24, 405 
Smoothing filter, 22 
Soft decision decoding, 25 
Sonar processing, 2 
Speaker verification, 2 
Spectral components, 132, 159 
Spectrum analyzers, 24 
Speech compression, real-time, 25, 27 
Speech enhancement/speech processing/speech 

recognition/speech synthesis, 2 
Speech-to-text dictation, 2 
Spline function, linear phase finite impulse 

response (FIR) filters 272-273 
Spread spectrum, 2 
Stability 

bounded-input bounded output (BIBO), 

77-78 
Jury-Marden test, 78-81 

z-transform theory, 77-81 
Steady-state response, 63-64 
Stopband filter 

equiripple first impulse response (FIR) filter 

design, 285 
Unear phase finite impulse response (FIR), 
263 

realization using MATLAB, 337 
Stopband frequency, finite impulse response 

(FIR) filters, 293-294 
Storage, digital filters, 24 
Switched-capacitor filters, 4, 28 
Symmetric coefficients, linear phase finite 

impulse response (FSR) filters, 252-254, 

256, 258-259 
Symmetry property, discrete-time Fourier 

transform, 145-147 
Synthesizers, 24 

Tapped delay filter, see Finite impulse response 

(FIR) filters 
Telecommunications applications 

mobile phone network, 2, 25-28 

overview of, 1-2 
Texas Instruments, 383-384, 386-388 
Text-to-speech translation, 2 
Third-generation (G3) mobile phones, 2 
Third-order lowpass filter, 20, 22 



Three-dimensional (3D) images, 2 
Time-division multiple access (TDMA) 

technology, 2, 25 
Time-domain analysis 

convolution, 65-70 

defined, 38 

difference equations, 52-64 

linear, time-invariant system, 32-41 

MATLAB functions, 81-93, 
108-110 

models, 70-77 

problems, 94-110 

stability, 77-81 
Time-invariant system 

convolution sum, 38-41 

discrete-time system models, 33-36 

overview of, 32-33 

recursive algorithm, 36-38 

z-transform theory, 41-59, 64-65 
Time reversal 

property, discrete-time Fourier transform 
(DTFT), 128-129 

z-transform theory, 73 
Time-shifting property, discrete-time Fourier 
transform (DTFT), 127-128, 131, 
139, 141 
Transfer function, 251, 258, 303 
Transient response, 63-64 
Transition bands, 24 

Transversal filter, see Finite impulse response 

(FIR) filters 
Triangular window, finite impulse response 
(FIR) filters 
implications of, 266n 
windowed filters, 276 
Trigonometric functions, MATLAB, 
401 

Truncation, quantized filter analysis, 
365 

Two-complementary form, quantized filter 

analysis, 362 
Two-dimensional (2D) images, 2 
Type I finite impulse response (FIR) filters 
characteristics of, 252-253, 257-258, 260, 

267, 269, 281, 283, 290 
filter realizations, 310-311 
Type II finite impulse response (FIR) filters 
characteristics of, 253-254, 257, 260, 276, 

281, 283, 290 
filter reaUzations, 310-311 
Type ni finite impulse response (FIR) filters, 

254, 257, 260, 281-283, 291 
Type IV finite impulse response (FIR) filters, 
255-257, 260, 281, 283, 291 
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Ultrasound imaging, 2 

Unit impulse function, discrete-time system, 9 

Unit impulse response 

discrete-time Fourier transform, 143 
infinite impulse response (IIR) filters, 220 
linear phase finite impulse response (FIR) 
filters, 252 

time-domain analysis, 37-38, 72-73, 89-90 
Unit pulse function, discrete-time system, 

9- 10 

Unit sample function, discrete-time system, 9 
Unit sample response, time-domain analysis, 
37, 67 

Unit step function, discrete-time system, 

10- 12 

Unit step sequence, discrete-time Fourier 
transform 

conjugation property, 145 

differentiation property, 139-142 

multiplication property, 142-145 

overview of, 138-139 

symmetry property, 145-147 
Unsigned fixed-point binary nimiber, 361 

Vectors 

finite impulse response (FIR) filter: 

equiripple design, 285 

realizations, 328, 331, 333 
infinite impulse response (IIR) filter 

design, 239 

realizations, 328, 331, 333 
Very large-scale integration (VLSI) technology, 

20, 383 
VHDL, 383 
Video compression, 25 
Videoconferencing, 3 
Visitor location register (VLR), 26 
Visual DSP-I-I-, 389 
Vocoders, 24 

Voice over Internet protocol (VoIP), 1-2 
Voice recognition, 25 

Waveform coding, 25 
Weather monitoring, 2 



Weighting function, equiripple linear phase 
finite impulse response (FIR) filter, 
283-284 

Windowed finite impulse response (FIR) filters, 
design using MATLAB 
filter order estimation, 273-275 
FIR filter design, 275-280 
Windows functions, finite impulse response 

(FIR) filters, 266-268 
Wordlength, in quantized filter analysis, 354, 

361, 366, 370, 375 
Workspace, defined, 392 
Worst-case analysis, 24 

X-rays, 2 

XDS5 10 JTAG Emulator, 388-389 
xPC Target, 385 

Yule-WaUcer approximation, 238-239 

Zero input response, 49-50, 54, 58-59, 61, 

85, 94 

Zero-order (ZOH) circuit, 4, 6-7 

Zero state response, 49-50, 54, 58-59, 61, 63, 

87, 94 
Z transform 
defined, 19 

frequency-domain analysis, 163-164 
theory 

applications, generally, 56-58 
characterized, 41-49, 82, 93-94, 126 
convolution, 65-70 
Unearity of system, 50 
methodology, 64-65 
models, 70-77 
problems, 94-110 
properties of 7. transforms, 77 
solution using MATLAB functions, 
81-93 

solving difference equations, 51-64 
stability, 77-81 
time-invariant system, 50-51 
zero input and zero state response, 
49-50, 94 



